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CHAPTER  I 


INTRODUCTION 


Overview 

One  of  the  primeory  objectives  of  the  foreign  policy 
of  the  United  States  is  the  creation  of  conditions  in 
which  we  and  other  nations  will  be  able  to  work  out  a 
way  of  life  free  from  coersion.  ...  We  shall  not 
realize  our  objectives  however,  unless  we  are  willing 
to  help  free  peoples  to  maintain  their  free  institu¬ 
tions  and  their  national  integrity  against  aggressive 
movements  that  seek  to  impose  upon  them  totalitarian 
regimes.  .  .  . 

I  believe  that  it  must  be  the  foreign  policy  of  the 
United  States  to  support  free  people  who  are  resisting 
attempted  subjugation  by  armed  minorities  or  by  outside 
pressures  .  .  .  the  free  people  of  the  world  look  to  us 
for  support  in  maintaining  their  freedom.  If  we  falter 
in  our  leadership,  we  may  endanger  the  peace  of  the 
world,  and  we  shall  surely  endanger  the  welfare  of  our 
own  nation  [15:5-6]. 

With  his  address  to  Congress  on  March  12,  1947, 
President  Trxaman  opened  a  new  period  in  American  foreign 
policy — one  in  which  the  United  States  has  taken  an  active 
role  in  supporting  the  defense  of  allies  and  other  friendly 
nations.  America's  commitment  to  international  security 
has  continued  to  this  day.  A  security  assistance  program 
vdiich  had  modest  beginnings  in  1947  has  since  grown  dra¬ 
matically  in  magnitude  and  scope  to  become  an  established 
tool  of  U.S.  foreign  policy.  In  1964,  the  value  of  Foreign 
Military  Sales  (FMS)  programs  exceeded  Grant  Aid  for  the 
first  time.  Grant  Aid  is  now  being  phased  out,  but  FMS 
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continues  to  grow  with  over  $15  billion  in  FMS  agreements 
signed  in  FY  1980  (30) . 

This  thesis  is  concerned  with  FMS.  More  spe¬ 
cifically,  the  focus  is  on  the  difference  between  the  price 
estimates  given  for  defense  articles  and  services  and  the 
actual  price  paid  by  the  customer.  There  have  been  justi¬ 
fiable  complaints  from  FMS  customers  that  inaccurate  esti¬ 
mates  have  caused  great  inconveniences  and  hurtful  budge¬ 
tary  compromises  (16) .  These  complaints  cannot  be  ignored — 
particularly  in  light  of  the  economic  and  political  impli¬ 
cations  of  FMS.  This  thesis  can  address  only  part  of  the 
problem.  Further  study  will  be  recommended  based  on  the 
findings  of  this  initial  study.  Scores  of  countries  now 
obtain  defense  equipment  and  services  through  United 
States  Security  Assistance  programs.  It  is  in  the  best 
interest  of  all  parties  that  these  programs  continue  and 
be  properly  administered. 

There  seems  to  be  no  better  way  to  gain  an  appreci¬ 
ation  of  Security  Assistance,  and  in  particular.  Foreign 
Military  Sales,  than  to  provide  a  sketch  of  the  legisla¬ 
tive  history  of  these  programs.  Such  a  review  will  put 
FMS  in  its  rightful  place  as  a  basic  element  of  U.S. 
foreign  policy  and  will  show  how  changing  times  have 
required  changing  legal  authorizations  for  FMS  progreuns. 

This  review  will  be  followed  by  a  discussion  of  the 
magnitude  of  today's  FMS  programs  and  a  brief  explanation 
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of  the  FMS  process.  Finally,  the  research  problem  and 
objective  for  this  thesis  will  be  presented. 

Legislative  Background 

Since  President  Trximan's  declaration  of  principles 
in  1947,  foreign  assistance  programs  have  been  a  corner¬ 
stone  of  United  States  foreign  policy  (15:7).  As  a  result 
of  President  Trvunan's  strong  belief  in  foreign  assistance 
programs,  the  National  Security  Act  of  1947  was  passed  by 
Congress.  This  act  provided  economic  aid  and  military 
assistance  to  Greece  and  Turkey  and  was  to  be  the  predeces¬ 
sor  for  all  subsequent  military  assistance  legislation  (19) . 

United  States  foreign  aid  policy  has  changed  a 
great  deal  since  1947,  but  is  solidly  based  on  legislative 
direction  and  remains  a  vital  part  of  America's  foreign 
policy.  A  chronological  outline  of  military  assistance 
legislation  highlights  some  of  the  changes: 

1.  The  Mutual  Defense  Assistance  Act  of  1949 
authorized  Grant  Aid  assistance  to  our  NATO  allies  and  was 
instrumental  in  rearming  Europe  after  the  devastation  of 
World  War  II.  Three  forms  of  aid  were  provided  through 
this  act;  (a)  machinery  and  raw  materials,  (b)  direct 
transfer  of  military  equipment,  and  (c)  technical  assist¬ 
ance  (20)  . 

2.  The  Mutual  Security  Act  of  1951  consolidated 
the  administration  of  aid  programs  under  the  newly 
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established  Mutual  Security  Agency.  This  was  the  first  of 
many  attempts  at  improving  the  administration  of  foreign 
aid  programs.  However,  administrative  duties  were  frag¬ 
mented  under  this  act  with  the  DOD  administering  military 
assistance  programs  and  the  State  Department  administering 
economic  aid  and  technical  assistance  programs  (21) . 

3.  The  1951  act  was  supplemented  in  1953  with  the 
Mutual  Assistance  Act  of  1953.  This  act  abolished  the 
Mutual  Security  Agency  and  consolidated  the  administration 
of  the  various  aid  progreims  under  the  Foreign  Operations 
Administration  (22)  .  (This  Administration  has  since  been 
replaced  by  the  Agency  for  International  Development.) 

4.  The  Mutual  Security  Act  of  1954  is  notaible  for 
the  fact  that  it  gave  the  State  Department  the  responsi¬ 
bility  to  license  the  export  of  arms  from  the  U.S.  (23) . 
This  provision  had  a  significant  impact  on  later  legisla¬ 
tive  developments  concerning  FMS  and  on  the  FMS  business 
itself . 

5.  A  major  overhaul  of  the  aid  programs  was 
carried  out  under  the  Foreign  Assistance  Act  of  1961. 
Although  this  Act  was  aimed  at  Grant  Aid  rather  than 
Foreign  Military  Sales,  it  authorized  sales  and  contained 
several  points  relevant  to  later  FMS  policy; 

a.  The  President  was  given  authority  to 
approve  recipients  of  aid  and  to  stipulate  the  terms 


involved. 


b.  The  Secretary  of  State  was  given  responsi¬ 
bility  for  foreign  aid  policy  and  the  supervision  and 
coordination  of  aid  programs. 

c .  The  military  items  obtained  from  aid  pro¬ 
grams  were  to  be  restricted  to  defensive  uses  and  could 
not  be  transferred  to  a  third  party  without  presidential 
authorization . 

This  act  also  created  the  Agency  for  International  Develop¬ 
ment  (AID)  vAiich  is  still  active  (24)  . 

6.  The  Foreign  Military  Sales  Act  of  1968  (renamed 
the  Arms  Export  Control  Act  of  1968)  authorized  the  Presi¬ 
dent  (a)  to  sell  defense  articles  and  services,  (b)  to 
enter  into  contracts  for  the  procurement  of  defense 
articles  and  services  for  sale  to  foreign  nations,  (c)  to 
finance  the  procurement  of  defense  articles  and  services 
by  foreign  nations,  and  (d)  to  guarantee  credit  to  PMS 
purchasers  as  he  sees  fit  (25)  . 

Today's  governing  legislation  is  the  International 
Security  Assistance  and  Arms  Export  Control  Act  of  1976 
(AECA) ,  as  amended.  This  act  consolidated  and  revised  all 
preceding  foreign  assistance  legislation.  It  states  that 
the  ultimate  goal  of  the  United  States  is  to  have  a  world 
free  from  the  dangers  and  burdens  of  armaments  (5:734) . 
These  are  some  of  the  most  important  provisions  of  the 
act: 
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1.  Military  Assistance  Advisory  Groups  (MAAGs) 
overseas  were  to  be  terminated  or  if  authorized  by  Congress, 
reduced  in  size. 

2 .  Grant  Aid  programs  were  to  be  terminated  on 
30  September  1977. 

3.  The  U.S.  was  to  promote  arms  control. 

4.  Future  sales  were  to  be  held  to  current  (1976) 

levels . 

5.  FMS  customers  were  liable  for  all  costs  incurred 
by  the  USG  when  carrying  out  FMS  programs. 

6.  Within  certain  limits,  presently  sales  exceed¬ 
ing  $25  million  or  major  defense  equipment  costing  $7 
million  or  more.  Congress  was  given  the  option  of  vetoing 
a  sale. 

7.  The  President  was  authorized  to  designate  items 
placed  on  the  Munitions  List  (5) . 

The  wide  range  of  controls  and  restraints  put  forth  in 
this  act  imply  that  by  1976  arms  transfers  by  the  U.S. 
were  a  matter  of  concern  to  many  in  the  government.  How¬ 
ever,  by  its  very  existence,  the  AECA  emphasizes  that  FMS 
programs  are  still  very  much  a  tool  of  America's  foreign 
policy  and  are  governed  by  legislatively  imposed  controls. 

FMS  Programs 

In  the  business  world.  Arms  Sales  or  Ainns  Trans¬ 


fers  are  called  Military  Export  Sales  and  can  occur  either 


on  a  government-to-government  basis  or  on  a  U.S.  industry- 
to-foreign  government  basis  (28:1,10).  Those  sales  made  by 
U.S.  industry  directly  to  a  foreign  buyer  and  not  adminis¬ 
tered  by  the  DOD  are  defined  as  commercial,  or  direct  sales 
(28:1,3).  Government- to-govemment  arrangements  for  the 
sale  of  defense  articles  and  services  managed  through  the 
DOD  are  defined  as  Foreign  Military  Sales  programs  (28:1,7) 
Some  examples  of  these  sales  include  not  only  aircraft, 
such  as  the  McDonnell  Douglas  F-4  and  the  Northrup  F-5, 
but  also  spare  parts,  support  equipment,  maintenance  ser¬ 
vices,  cind  training. 

Foreign  Military  Sales  have  three  principle  objec¬ 
tives:  (1)  to  provide  the  defensive  strength  of  our  allies 
and  selected  friendly  foreign  countries,  (2)  to  promote  the 
concept  of  cooperative  logistics,  and  (3)  to  offset  the 
unfavorable  balance  of  payments  (ll:p.ll-l) . 

As  a  form  of  international  business,  PMS  is  con¬ 
ducted  by  the  Department  of  Defense  under  the  supervision 
and  authority  of  the  Secretary  of  State  (13:7).  In  addi¬ 
tion  to  being  cin  integral  part  of  U.S.  foreign  policy,  FMS 
programs  have  become  an  important  business.  A  glance  at 
the  values  of  FMS  agreements  made  during  the  past  ten 
years  helps  show  how  the  programs  have  increased  in  size. 
The  value  of  FMS  agreements  made  during  FY  1971  was  $1.3 
billion.  In  FY  1974,  a  total  of  $10.3  billion  of  FMS  agree 
ments  were  signed.  The  value  of  agreements  for  FY  1977 


dropped  to  $8.3  billion,  but  in  FY  1980,  the  upward  trend 
recovered  with  $15.2  billion  in  FMS  agreements.  The  cumula 
tive  value  of  FMS  agreements  made  from  1950  through  1980 
was  $110.5  billion.  During  that  thirty-year  period,  agree¬ 
ments  were  signed  with  over  ninety  nations  (30:1-5) . 

Looking  at  FMS  in  terms  of  its  impact  on  the  U.S. 
Icdsor  market,  the  Congressional  Budget  Office  has  estimated 
that  based  on  an  annual  FMS  program  of  $8.2  billion,  42,000 
jobs  are  supported  by  every  $1  billion  in  FMS.  Other 
studies  have  different  results.  The  Carter  Administration 
determined  that  $1  billion  in  FMS  accounted  for  about 
38,000  jobs  (2:179).  Without  trying  to  resolve  the  differ¬ 
ences  between  these  studies,  the  fact  remains  that  the  use 
of  this  tool  of  foreign  policy  has  a  significant  impact  on 
employment  in  U.S.  defense-related  industries. 

FMS  Process 

An  understanding  of  the  FMS  process  will  help  the 
reader  understand  some  problems  inherent  in  FMS  programs. 
Among  those  problems  is  that  of  giving  the  Purchaser  an 
estimated  cost  for  the  items  furnished  through  FMS. 

General  Process.  The  details  of  the  FMS  process 
cannot  be  easily  simplified,  but  generally  when  an  eligible 
country  expresses  a  desire  to  buy  articles  or  services 
either  through  a  letter  of  request  or  otherwise,  represen¬ 
tatives  of  that  nation  meet  in  conference  with  U.S. 


representatives  for  the  pxirpose  of  negotiations.  If  the 
negotiations  lead  to  an  agreement,  a  contract  is  prepared. 
This  contract,  with  supplements  as  necessary,  is  called  a 
"Letter  of  Offer  and  Acceptance"  (LOA) .  The  LOA  is  some¬ 
times  referred  to  simply  as  the  DD  Form  1513;  which  is  the 
number  of  the  DOD  form  used  as  the  contract  instrument 
(14:12-14).  This  form  is  used  for  all  FMS  agreements,  thus 
it  is  an  important  source  of  information  for  anyone  conduct¬ 
ing  research  in  this  area. 

The  DD  Form  1513  serves  two  purposes.  It  is  the 
vehicle  for  the  United  States  Government  (USG)  offer  of 
defense  articles  and  services  to  a  foreign  p\ar chaser  and 
is  also  the  instrument  of  acceptance  (28:111, D-1).  The 
USG  specifies  the  items  or  services  to  be  provided  and 
gives  the  Purchaser  an  estimate  of  the  cost  and  delivery 
date.  The  terms  of  payment  will  vary  with  the  items 
involved  but  in  any  case  (28;III,D-14)  the  Purchaser  is 
advised  that  the  price  to  be  paid  will  be  "the  total  cost 
to  the  USG  [29:2]."  The  USG  offer  is  signed  by  an  auth¬ 
orized  U.S.  Military  Department  or  Defense  Agency  repre¬ 
sentative  before  it  is  submitted  to  the  Purchaser  for 
acceptance  (28 ;II,D-12) .  If  it  is  accepted,  it  is  then 
signed  by  an  authorized  representative  of  the  Purchasing 
government.  These  two,  the  seller  and  buyer,  constitute 
the  competent  and  responsible  parties  of  the  contract. 


Methods  of  Participation.  There  are  three  methods 
by  which  a  foreign  country  can  participate  in  FMS.^  One 
method  is  via  a  Cooperative  Logistics  Supply  Support 
Arrangement  (CLSSA) .  Using  this  method,  a  country  can 
establish  an  equity  in  the  DOD  stock  system  against  which 
it  can  receive  support  on  a  basis  equal  to  that  of  a  com¬ 
parable  DOD  unit.  Another  method  is  the  blanket  order 
case.  The  customer  signs  a  Letter  of  Offer  and  Acceptance 
(LOA)  for  a  self-determined  amount  of  money  against  vAiich 
requisitions  can  be  placed  for  as  yet  undetermined  items. 

The  third  method  is  the  defined  order  case,  for  which  the 
Purchaser  specifies  the  items  and  quantities  desired  when 
the  LOA  is  written.  The  responsible  DOD  component  makes 
cin  estimate  of  the  cost  of  the  items  and  uses  this  estimate 
as  the  basis  for  the  cost  of  the  LOA  (28 : II ,F-2, 2a, 2b) . 

Pricing .  Pricing  for  FMS  is  generally  based  on  the 
fact  that  according  to  the  AECA  the  USG  must  recover  all 
costs  relating  to  FMS  and  at  the  same  time  avoid  any  exces¬ 
sive  profit  (5) .  Because  of  this  requirement,  the  DOD  has 
to  consider  a  number  of  pricing  elements  before  it  can  give 
a  Purchaser  a  price  estimate.  Some  of  the  price  elements 
are  (12:p.l5-5) 

^These  methods  may  be  combined  for  special  programs, 
such  as  sale  and  initial  support  of  an  aircraft  system. 

2 

Not  all  of  these  elements  are  applied  to  each  item. 
The  appropriateness  of  each  pricing  element  depends  on 
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1 .  Cost  of  the  items  or  services 


2.  Nonrecurring  RDT&E  and  production  costs 

3 .  Administrative  charge 

4 .  Asset  use  charges 

5.  Packing,  crating  and  handling 

In  order  to  comply  with  the  AECA,  which  stipulates  that 
DOD  will  recover  full  costs,  the  estimates  are  adjusted 
after  delivery  so  the  Purchaser  can  be  billed  for  all  costs 
incurred  (28 : III,C-7) .  The  DD  Form  1513  makes  it  clear 
that  the  costs  cited  are  only  estimates  and  that  the  Pur¬ 
chaser  is  obligated  to  pay  the  total  cost  of  the  items. 
Although  the  USG  states  that  it  will  "use  its  best  efforts 
to  advise  the  Purchaser  ...  of  any  identifiable  cost 
increase  ...  in  excess  of  10  percent,"  the  Purchaser  is 
obliged  to  pay  the  total  costs  whether  or  not  the  USG 
advises  of  the  increase  in  a  timely  manner  (29:2)  . 

As  can  be  imagined,  this  approach  to  price  deter¬ 
mination  and  notification  can  be  a  problem.  It  can  disrupt 
the  Purchaser's  budget  and  cause  dissatisfaction  with  the 
FMS  process.  Although  present  pricing  practices  have  not 
reduced  the  demand  for  arms  and  services  from  the  USG,  in 
view  of  the  significance  of  FMS  as  a  part  of  U.S.  foreign 
policy,  it  is  important  that  the  United  States  Government 

whether  the  item  will  be  supplied  from  DOD  stocks,  whether 
those  stocks  will  be  replaced,  or  whether  the  item  will  be 
furnished  through  direct  procvirement . 
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maintain  a  reputation  as  a  reliable  and  responsible  sup¬ 
plier  of  defense  articles.  One  aspect  of  this  reputation 
is  the  accuracy  of  price  estimates  quoted  to  foreign  govern 
ments  (28 ;III,C-4a) . 

Problem  Statement 

Interviews  with  individuals  working  in  FMS  have 
indicated  that  a  comprehensive  study  of  the  accuracy  of 
price  estimates  would  be  useful.  While  it  would  not  be 
surprising  to  find  some  differences  between  initial  and 
final  price  quotations <  there  is  no  statistical  evidence 
to  substantiate  the  general  perception  that  price  estimates 
for  FMS  cases  are  inaccurate.  A  review  of  appliccible 
literature  reveals  that  no  comprehensive  study  has  been 
made  to  verify  the  extent  of  inaccurate  estimates,  although 
a  number  of  individual  inaccurate  estimates  have  been  cited 

Justif ication 

According  to  Mr.  Roger  E.  Reynolds,  the  Director 
of  Security  Assistance  Management  and  Policy,  Headquarters 
AFLC,  a  comprehensive  study  of  the  accuracy  of  estimated 
costs  could  provide  the  necessary  statistical  evidence  to 
initiate  further  investigation  into  such  areas  as  price 
estimating  procedures  (18)  .  The  findings  of  this  study  may 
or  may  not  substantiate  the  general  opinion  that  cost 
estimates  are  inaccurate.  The  study  may  well  determine 
that  only  a  small  portion  of  the  estimates  are  inaccurate. 


or  vice  versa.  A  study  completed  in  August  1969  entitled 
"The  Buyer's  View  of  the  Management  of  the  United  States 
Foreign  Military  Sales  Program"  stated  that  "The  customer's 
complaint  is  that,  in  too  many  instances,  prices  charged 
substantially  exceed  the  estimated  price  •  .  .  [6:71]." 

This  report  also  cited  eighteen  examples  of  price  varia¬ 
tions  provided  by  a  foreign  country  representative  (6:143)  . 
The  authors  conceded  that  the  examples  given  may  represent 
only  extreme  instances  and  left  the  topic  open  for  further 
research  (6:71).  In  August  1975,  the  Army  Logistics  Man¬ 
agement  Center  initiated  a  study  which  was  to  improve  the 
calculations  and  documentation  of  price  estimates  for  FMS. 
The  study  was  initiated  because  there  had  been  ",  .  .a 
significant  number  of  FMS  cases  ...  in  which  the  price 
estimates  for  material  were  inaccurate  and  unrealistic 
[17:7]."  In  November  of  that  same  year,  a  Defense  Security 
Assistance  Agency  point  paper  entitled  "Price  and  Avail¬ 
ability  Information  for  Planning  (Preliminary  P&A) "  stated 
that  there  was  a  "general  sJcepticism"  that  price  estimates 
could  be  both  timely  and  reliable  (8:92) .  A  more  recent 
research  effort,  in  June  1980,  entitled  "Determination  and 
Analysis  of  Problems  in  Air  Force  Foreign  Military  Sales 
of  Munitions,"  documented  the  problems  encountered  in  the 
sale  of  munition  items  via  FMS  from  the  point  of  view  of 
those  in  various  United  States  Department  of  Defense 
activities  vAio  work  with  FMS.  Included  in  Appendix  H  of 


that  report  was  a  list  of  problems  cited  by  foreign  mili¬ 
tary  officers  v^o  are  either  working  in  or  have  knowledge 
of  FMS.  One  of  the  problems  listed  was  that  "the  final 
cost  [of  FMS]  was  normally  higher  than  the  agreed  upon  cost 
[4:192] 

Intent  of  Study 

The  results  of  this  study  are  intended  to  lend 
credence  to  or  help  dismiss  the  perception  that  price  esti- 
ates  are  inaccurate.  This  study  may  facilitate  the 
identification  of  specific  sources  of  both  accurate  and 
inaccurate  price  estimates  and  guide  FMS  managers  to  revise 
procedures  as  necessary.  Such  revisions  could  have  a  sig¬ 
nificant  effect  on  the  price  estimates  of  future  Foreign 
Military  Sales  cases. 

Scope 

Foreign  Military  Sales  programs  are  managed  by  each 
of  the  United  States  Department  of  Defense  Military  Depart¬ 
ments  and  their  subordinate  commands.  This  study  is  limited 
to  those  cases  managed  by  the  Air  Force  Logistics  Command 
(AFLC) ,  Department  of  the  Air  Force.  AFLC  handles  a 
sizable  portion  of  FMS.  At  the  end  of  FY  1980,  AFLC  was 
managing  2642  open  FMS  cases  totaling  $11.7  billion  (1). 
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3 

Of  the  three  methods  of  participating  in  FMS, 
only  defined  order  cases  for  non-systems  sales  will  be 
considered.  Because  the  dollar  value  limit  of  blanket 
order  CLSSA  cases  is  normally  determined  by  the  customer, 

4 

these  cases  have  been  excluded  from  this  study.  Cases 
for  the  sale  of  defense  systems  and  associated  support  are 
excluded  because  many  of  them  incorporate  subcases  which 
are  managed  by  USAF  commands  other  than  AFLC  and  are  thus 
outside  the  scope  of  this  thesis. 

In  order  to  have  accurate  information  as  to  the 
final  cost  of  items  delivered  on  defined  order  cases, 
research  will  be  limited  to  closed  cases.  These  are  cases 
for  which  "all  materiel  has  been  delivered  and/or  all  ser¬ 
vices  have  been  performed  [and]  all  financial  treuis- 
actions  [28:1,3] "  have  been  completed .  In  an  effort  to 
focus  as  much  as  possible  on  current  events,  the  data  col¬ 
lection  will  be  limited  to  those  cases  which  have  been  both 
implemented  and  closed  within  the  past  five  years  (1976- 
1980)  . 

When  signing  an  LOA,  a  Purchaser  agrees  not  only 
to  pay  for  materiel  and  services  ordered,  but  also  for 

3 

Defined  order,  blanket  order.  Cooperative  Logis¬ 
tics  Supply  Support  Arrangement  (CLSSA) . 

4 

While  it  is  true  that  the  DOD  provides  a  recom¬ 
mendation  of  appropriate  stock  levels  for  each  CLSSA  pro¬ 
gram,  the  Purchaser  is  able  to  make  adjustments  to  this 
recommendation  and  can  thereby  determine  the  materiel  value 
of  the  CLSSA  program  ( 27;pp. 7-54 , 7-55) . 
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appropriate  surcharges,  such  as  administrative  and  acces¬ 
sorial  costs.  The  surcharges  are  usually  calculated  as  a 
percentage  of  the  material  value  and  therefore  are  only  a 
reflection  of  the  material  value.  They  will  not  be  con¬ 
sidered  in  this  study.  Also,  this  study  will  not  analyze 
the  price  estimating  procedures  used  in  writing  FMS  cases. 
While  this  is  a  legitimate  area  of  inquiry,  this  study 
will  take  the  estimates  as  they  were  recorded  and  proceed 
to  measure  how  accurate  they  proved  to  be. 

Research  Objective 

The  objective  of  this  study  is  to  determine  the 
accuracy  of  price  estimates  given  to  foreign  customers  by 
AFLC  for  defined  order  FMS  cases.  The  estimates  will  be 
analyzed  according  to  the  categories  of  defined  order 
cases  involved  eind  according  to  the  AFLC  activity  vrtiich 
prepared  the  estimate. 

Research  Questions 

1.  What  is  an  acceptable  level  of  accuracy  for 
the  estimated  costs? 

a.  Customers'  viewpoint 

b.  AFLC  viewpoint 

2.  What  is  the  accuracy  of  cost  estimates  for  FMS 
cases  overall? 

3 .  What  is  the  accuracy  of  cost  estimates  by 


source  of  estimate? 


4 .  What  is  the  accuracy  of  cost  estimates  by  cate¬ 
gory  of  case? 

5.  What  is  the  accuracy  of  cost  estimates  on 
selected  FMS  items?  Can  these  be  related  according  to 
category  of  case  or  price  estimating  source? 

Plan  of  Presentation 

Chapter  I  was  an  introduction  to  the  legislative 
background  of  FMS  and  the  FMS  process.  It  introduced  the 
research  problem,  scope,  objectives,  and  questions. 

Chapter  II  outlines  the  methodology  and  plan  for  data 
collection.  Chapter  III  presents  a  detailed  analysis  of 
the  data.  Chapter  IV  states  the  findings  of  the  research, 
conclusions,  recommendations,  and  areas  for  further 
research. 
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CHAPTER  II 


METHODOLOGY 

This  research  methodology  is  established  to  obtain 
the  answers  to  the  research  questions  stated  in  Chapter  I. 
These  answers  will  help  achieve  the  research  objective  of 
this  thesis. 

Research  Question  Number  1 

What  is  an  acceptable  level  of  accuracy  for  the 
estimated  costs? 

a.  Customers’  viewpoint 

b .  AFLC  viewpoint 
Two  procedures  will  be  used  to  determine  the  accept¬ 
able  level  of  accuracy  for  estimated  costs.  First  will  be 

a  review  of  all  Department  of  Defense  Directives  and 
Instructions,  Air  Force  Regulations,  written  policy  and 
internal  guidance  that  may  establish  a  standard  for  the 
accuracy  of  estimates.  Second  will  be  a  series  of  struc¬ 
tured  interviews  with  U.S.  Air  Force  personnel  involved  in 
FMS  and  with  knowledgeable  representatives  of  purchasing 
countries,  such  as  the  Foreign  Liaison  Officers  assigned  to 
Wright-Patterson  AFB.  The  combination  of  interviews  and 
literature  review  will  be  used  to  establish  the  acceptable 
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level  of  accuracy  for  estimated  costs  frcan  the  customer's 
viewpoint  as  well  as  the  AFLC  viewpoint. 


Research  Questions  Number 
2,  3,  and  4 

2.  What  is  the  accuracy  of  cost  estimates  for 
cases  overall? 

3.  What  is  the  accuracy  of  cost  estimates  by 
source  of  estimate? 

4 .  What  is  the  accuracy  of  cost  estimates  by 
category  of  case? 

To  answer  these  questions  a  sample  of  data  will 
be  drawn  from  the  defined  population.  Using  the  sample 
data,  a  separate  statistical  analysis  will  be  completed 
resulting  in  solutions  to  each  question. 

Population.  The  population  consists  of  all  AFLC 
managed  defined  order  FMS  cases.  Data  will  be  collected 
from  those  cases  that  have  been  implemented  and  closed 
within  the  past  five  years.  The  five  year  period  from 
1976  through  1980  yields  a  population  of  430  cases  which 
meet  the  above  criteria. 

Sample .  The  data  will  be  stratified  by  the  cate¬ 
gories  of  cases  to  determine  the  number  of  cases  in  each 
categoiry.^  From  each  of  these  stratum,  a  random  sample 

^For  a  description  of  the  categories  of  defined 
order  cases,  see  Appendix  A. 


of  40  percent  of  the  cases  will  be  selected.  This  selec¬ 
tion  process  will  insure  the  sample  is  proportionally 
representative  of  the  population  both  by  category  and 
estimating  source. 

Data  Collection  Plan.  Data  collected  will  include 
the  estimated  cost  of  material  and  services  in  each  case 
and  the  final  material  and  services  value  of  each  case. 

The  estimated  cost  will  be  taken  frcm  the  entry  for  "Esti¬ 
mated  Cost"  on  the  DD  Form  1513  (or  1513-1,  1513-2  as 
2 

appropriate) .  The  final  material  value  will  be  the  entry 
"Delivered  Value"  (Del  Val)  as  recorded  for  each  case  on 
the  Program  Status  of  Selected  Control  Elements  (R47:H051. 
NH5AT) .  This  value  is  the  cost  of  material  or  services 
delivered.  It  does  not  include  surcharges,  such  as  adminis 
trative  and  accessorial  costs. 


Analysis  of  Data.  The  Estimated  Cost  (EC)  and 
Total  Delivered  Value  (TDV)  will  be  used  to  calculate  the 
accuracy  of  each  estimate  as  a  percentage  of  the  delivered 
value : 


=  %  accurate 


The  application  of  DD  Forms  1513-1  and  1513-2  to 
this  study  is  discussed  in  Appendix  B. 


For  example 


Estimated  Cost 
Total  Delivered  Value 

EC  _  3^ 

TDV  “  150 

The  computer  program  "Statistical  Package  for  the  Social 
Sciences"  (SPSS)  will  be  used  to  compute  the  accuracy  of 
the  estimate  for  each  case  in  the  Scunple.  The  accuracy 
of  the  cases  in  the  sample  will  be  grouped  according  to 
their  relation  to  the  acceptable  level  of  accuracy  as  deter¬ 
mined  through  research  question  1.  Analysis  of  this  dis¬ 
tribution  will  contribute  to  an  understanding  of  AFLC 
price  estimating  performance. 

Next,  the  mean  accuracy  for  this  entire  sample 
will  be  calculated.  This  mean  value  will  be  used  as  an 
estimator  of  the  true  population  mean  and  answer  research 
question  number  2,  which  was  to  determine  the  accuracy  for 
cases  overall. 

Finally,  we  will  draw  a  conclusion  about  the  value 
of  the  population  mean  based  on  the  simple  random  sample 
data.  Using  the  computed  mean  value  and  an  appropriate 
error  level,  we  will  test  which  of  the  following  conclu¬ 
sions  is  correct: 

Hg:  p  =  1,  the  estimated  costs  are  accurate; 

H, :  V  #  1/  the  estimated  costs  are  not  accurate 
^  (10:257). 


=  $100 
=  $150 

=  66.67%  accurate 
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To  answer  research  question  number  3 ,  the  cases 
in  the  sample  will  be  stratified  according  to  the  source 
of  the  price  estimates  given  in  each  case.  The  mean  accu¬ 
racy  of  the  cases  in  each  stratum  will  be  calculated.  The 
accuracy  of  the  costs  will  again  be  used  to  test  the  same 
alternative  conclusions.  This  analysis  will  allow  insight 
into  the  performance  of  various  price  estimating  sources. 

To  analyze  the  accuracy  of  costs  by  category  of 
case,  research  question  4,  the  sample  will  be  stratified 
by  category.  The  mean  accuracy  of  costs  will  be  computed 
for  each  category  and  used  to  test  the  two  possible  alterna¬ 
tive  conclusions.  This  procedure  will  answer  research 
question  number  4  and  provide  information  about  the  accu¬ 
racy  of  costs  for  case  categories. 

This  entire  method  of  data  collection  and  analysis 
will  determine  how  accurate  cost  estimates  are  overall, 
how  accurate  each  source  of  cost  estimate  is  and  how  accu¬ 
rate  estimates  are  for  each  category  of  case  in  the 
sample. 

Research  Question  Number  5 

What  is  the  accuracy  of  cost  estimates  on  selected 
FMS  items?  Can  these  be  related  according  to  category  of 
case  or  price  estimating  source? 

It  should  be  understood  that  a  single  FMS  case  can 
be  and  usually  is  composed  of  more  than  one  item. 


Consequently,  the  accuracy  of  the  estimated  cost  of  the 
case  is  subject  to  the  averaging  affect  of  the  accuracy  of 
the  estimated  cost  of  each  item  on  the  case.  By  selecting 
a  Scimple  of  individual  items,  the  accuracy  of  the  esti¬ 
mated  costs  caul  be  compared  to  the  accuracy  of  the  esti¬ 
mated  costs  of  cases.  This  comparison  will  add  signifi¬ 
cance  to  the  analysis  of  the  accuracy  of  cost  estimates 
for  Foreign  Military  Sales. 

Population.  To  determine  the  accuracy  of  cost 
estimates  for  selected  items,  the  random  sample  of  cases 
used  for  research  questions  2,  3,  and  4  will  be  used  as 
the  population.  Since  that  sample  was  selected  by  a  random 
method,  it  can  be  assumed  to  be  representative  of  the 
entire  population  under  study. 

Sample .  Because  the  population  of  concern  for 
this  research  question  is  itself  a  sample,  a  double  sam¬ 
pling  technique  will  be  used  to  select  a  sample  of  items 
to  study.  The  unit  price  of  each  item  ordered  through  the 
cases  in  the  population  will  be  recorded.  These  unit 
prices  will  then  be  grouped  into  a  series  of  price  ranges. 
The  items  from  the  price  range  with  the  highest  frequency 
will  be  used  as  the  sample  for  this  part  of  the  study. 

The  price  range  with  the  highest  frequency  is  expected  to 
be  the  most  likely  to  include  items  from  all  categories  of 
cases  and  from  all  estimating  sources.  The  items  selected 
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will  be  identified  by  case  identifier  and  according  to  the 
item  description  in  Block  13  of  the  DD  Form  1513. 

Data  Collection  Plan.  For  each  item  in  the  sample, 
the  original  estimated  cost  will  be  the  entry  on  the 
DD  Form  1513  (or  1513-1,  1513-2,  as  applicable)  labeled 
"Estimated  Unit  Cost"  (EUC) .  The  final  material  value 
will  be  the  "Actual  Delivered  Value"  for  that  item  as 
recorded  on  the  Consolidated  Status  Report  (R058 ,RCN:NC1AL) , 
divided  by  the  quantity  requisitioned  to  obtain  the 
Delivered  Unit  Cost,  (DUC) . 

Analysis  of  Data.  The  accuracy  of  each  estimated 
unit  cost  will  be  computed  by  dividing  the  Estimated  Unit 
Cost  by  the  actual  Delivered  Unit  Cost: 


EUC 

DUC 


%  accurate 


The  quotient  will  be  expressed  as  the  percent  accuracy  of 
the  estimated  cost  in  relation  to  the  delivered  value. 

SPSS  will  be  used  to  compute  the  accuracy  of  each 
item  in  the  sample  euid  to  compute  the  mean  accuracy  of  all 
items  as  a  group.  Additional  values  of  mean  accuracy  will 
be  obtained  for  these  items  as  classified  by  category  of 
case  and  by  source  of  cost  estimate. 

Using  the  previously  determined  level  of  accept¬ 
able  price  accuracy,  the  proportions  of  items  which  exceed 
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and  which  are  below  the  acceptable  level  can  be  determined. 
The  mean  values,  calculated  for  the  items  overall,  the 
separate  categories  of  items,  and  the  separate  estimating 
sources  will  be  used  to  draw  conclusions  about  the  indi¬ 
vidual  population  and  subpopulation  means.  Using  the  com¬ 
puted  mean  values  as  the  test  statistic,  and  an  appropri¬ 
ate  error  level,  we  will  repeat  the  statistical  test  to 
determine  which  of  the  following  conclusions  is  correct: 

Hq:  u  =  1/  the  estimated  costs  are  accurate; 

H, :  u  #  1/  the  estimated  costs  are  not  accurate 
^  (10:257). 
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CHAPTER  III 


ANALYSIS 

This  chapter  presents  an  analysis  of  the  data 
collected  through  interview  and  research.  A  descriptive 
analysis  is  used  to  answer  research  question  1.  Research 
questions  2,  3,  4,  and  5  are  answered  using  a  statistical 
analysis  of  the  collected  data.  Conclusions  of  this 
research  and  suggestions  for  further  research  follow  in 
Chapter  IV. 

Research  Question  Number  1 

What  is  an  acceptable  level  of  accuracy  for  the 
estimated  costs? 

a.  Customers'  view 

b.  AFLC  viewpoint 

The  objective  of  research  question  1  was  to  deter¬ 
mine  an  acceptable  level  of  accuracy  for  price  estimates 
quoted  on  DD  Forms  1513.  When  interviewed,  representa¬ 
tives  of  foreign  air  forces  vdiich  participate  in  FMS  and 
representatives  of  AFLC  both  agreed  that  an  acceptable 
level  of  accuracy  for  the  estimated  material  cost  of  a 
defined  order  case  was  ±10  percent  of  the  delivered  material 
value  (see  summary  of  interviews  in  Appendix  D) .  This  range 
of  accuracy  is  one  which  most  of  the  customers  said  they 
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I 

j 

I 

,1 
I 
1 

could  deal  with.  After  a  thorough  search  of  appropriate  1 

regulations,  directives,  and  policy  infornvation  nothing  ' 

was  found  explicitly  defining  an  AFLC  position  on  price  ’ 

estimate  accuracy.  However,  one  factor  which  probably  i 

influences  the  choice  of  ±10  percent  as  acceptable  by 
AFLC  personnel  is  the  fact  that  paragraph  A5b(l),  Annex  A, 
of  the  DD  Form  1513  states  that  the  United  States  Govern¬ 
ment  will  notify  the  customer  "of  any  identifiable  cost 
increase  that  may  result  in  an  increase  in  the  'Esti¬ 
mated  Total  Cost'  in  excess  of  10  percent." 

While  the  responses  to  the  interview  questions 
reflected  only  personal  opinions  and  were  not  necessarily 
the  official  view  of  any  Air  Force  or  government,  v/e  con¬ 
cluded  for  the  purpose  of  this  study  that  a  price  estimate 
that  was  within  ±10  percent  of  the  delivered  value  would  be 
considered  to  be  acceptably  accurate. 

Research  Question  Number  2 

What  is  the  accuracy  of  cost  estimates  for  cases 

overall? 

To  determine  the  accuracy  of  cost  estimates  overall 
a  40  percent  sample  was  drawn  at  random  from  the  popula¬ 
tion  of  430  AFLC  managed  defined  order  cases  that  had  been 
both  implemented  and  closed  within  the  past  five  years. 

These  cases  were  identified  using  two  reports;  (1)  DSAA 
Foreign  Military  Sales  Case  listing  (RCS  1200)  and 


2 


(2)  Program  Status  of  Selected  Control  Elements  (R47:H051. 
NH5AT) .  The  sample  was  selected  to  yield  category  propor¬ 
tions  equal  to  those  in  the  population  (i.e.,  21  percent 
"A"  cases,  27  percent  "L"  cases,  etc.)-  The  sample  size, 
n,  equaled  176  cases.  The  sample,  selected  at  random,  was 
representative  of  the  population  and  sufficiently  large  to 
apply  the  Central  Limit  Theorem^  to  the  distribution  of  x, 
the  sample  mean  accuracy . 

The  value  of  the  accuracy  (ACC)  of  each  case  was 
computed  as  a  ratio  of  the  Estimated  Cost  (EC)  divided  by 
Total  Delivered  Value  (TDV) .  The  value  of  ACC  could  be  any 
number  greater  than  0 . 


If  EC  <  TDV,  then  ACC  =  <  1; 

If  EC  =  TDV,  then  ACC  =  =  1; 

EC 

If  EC  >  TDV,  then  ACC  =  >  1. 

(Note  the  value  of  ACC  for  each  case  in  Appendix  E.) 

Table  1  indicates  the  proportional  breakdown  of 
the  sample  by  the  individual  values  of  ACC.  The  largest 
proportion  in  the  sample  is  ACC  >  1  where  the  Estimated 
Cost  is  greater  than  the  TDV  (59.1  percent).  The 

^"Central  Limit  Theorem.  For  almost  all  popula¬ 
tions,  the  sampling  distribution  of  x  is  approximately 
normal  when  the  simple  random  sample  size  is  sufficiently 
large  [10:202]." 
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TABLE  1 


PROPORTIONAL  BREAKDOWN  OF  SAMPLE 


Value  of  ACC 

n 

n/176 

ACC  <  1 

31 

.176 

ACC  =  1 

41 

.233 

ACC  >  1 

104 

.591 

TOTAL 

176 

1.00 

brecikdown  indicates  only  23.3  percent  of  the  sample  cases 
were  determined  accurate  (ACC  =  1). 

Using  an  acceptable  level  of  accuracy  of  +10  per¬ 
cent,  as  determined  in  question  1,  the  value  of  the  accept¬ 
able  accuracy  of  each  case  may  lie  within  the  range  of 
.9  <  ACC  <  1.1.  Table  2  indicates  the  breakout  of  the 
sample  proportions  using  ±10  percent  as  acceptable  limits 
on  ACC.  With  a  ±10  percent  accuracy  level,  40.9  E)ercent 
of  the  sample  fell  within  the  acceptable  range.  We  thus 
concluded  that  for  the  san^Jle,  40.9  percent  of  the  cases 
were  considered  acceptably  accurate. 

To  determine  the  accuracy  of  cost  estimates 
overall,  the  mean  value  of  ACC,  (x) ,  was  used  as  the  esti¬ 
mator  of  the  population  mean,  y.  The  mean  is  the  most  com¬ 
mon  and  useful  measure  of  central  tendency  of  a  distribu¬ 
tion  (9:27).  The  sample  mean,  x,  was  equal  to  1.664.  This 
value,  X  =  1.664,  was  used  to  test  the  null  hypothesis  (Hq) 
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TABLE  2 


PROPORTIONAL  BREAKDOWN  GIVEN  ±10  PERCENT 
ACCEPTABLE  ACCURACY 


Value  of  ACC 

n 

n/176 

ACC  <  .9 

18 

.102 

.9  _<  ACC  11.1 

72 

.409 

ACC  >  1.1 

86 

.489 

TOTAL 

176 

1.00 

that  the  mean  accuracy  is  equal  to  1,  against  the  alterna¬ 
tive  (Hj^)  that  the  mean  is  not  equal  to  1.  That  is: 

Hq:  y  =  1,  the  estimated  costs  are  accurate; 

y  1,  the  estimated  costs  are  not  accurate. 

The  goodness  of  any  statistical  test  of  an  hypo¬ 
thesis  is  measured  by  the  probabilities  of  making  a 
Type  I  or  Type  II  error,  denoted  by  the  symbols  a  and 
6,  respectively  [9:170]. 

The  a  limit  for  this  statistical  test  was  established  at 
.10.  This  value  indicates  the  probability  of  committing 
a  Type  I  error  when  the  true  mean,  y,  equals  1.  In  this 
analysis,  a  Type  I  error  was  committed  when  we  concluded 
that  the  estimates  are  not  accurate  and,  in  fact,  they 
were.  A  Type  II  error  was  committed  when  we  concluded  Hq, 
that  the  price  estimates  are  accurate  and,  in  fact,  they  are 
not  (see  Table  3) . 
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TABLE  3 


ILLUSTRATION  OF  TWO  TYPES  OF  ERRORS  (10:261) 


For  this  thesis,  both  Type  I  error  and  Type  II 
errors  were  serious.  If  a  Type  I  error  was  committed  (con¬ 
cluding  when  Hq  is  true)  ,  management  may  take  action  to 
correct  the  situation  when  no  action  is  required.  If  a 
Type  II  error  was  committed  (concluding  Hq  when  is  true) , 
it  implies  no  management  action  need  be  taken  vdien  in  fact 
there  is  a  problem.  Because  of  the  seriousness  of  both 

type  errors,  it  was  important  to  minimize  the  probability 
2 

of  both  a  and  6.  The  a  limit,  therefore,  was  established 
at  the  .10  level  for  this  and  all  subsequent  statistical 
tests.  The  6  level  (which  could  be  calculated  and  would 
differ  for  each  sample)  would  be  comparatively  low  based 
on  the  a  level  established.^ 

2 

"For  a  given  random  sample  size,  one  type  of 
error  probability  can  be  reduced  only  at  the  expense  of 
increasing  the  other  type  [10:268]." 

^For  further  discussion  of  hypothesis  testing  con¬ 
sult  Mendenhall,  Introduction  to  Probability  and  Statis¬ 


tics,  pp.  147-188. 


Using  a  =  .10  and  the  standard  error  of  the  seunple, 
s(x),  a  rejection  region  could  be  calculated  to  test  the  null 
hypothesis.  The  decision  rule  to  test  Hq  was: 

If  £  X  £  A2/  conclude  Hq; 

If  X  <  Aj^  or  X  >  A2,  conclude 

where,  A^^  =  +  z(a/2)s(x); 

A2  =  +  z(l-a/2)s(x)  (10:284). 

For  the  accuracy  of  the  cases  overall,  a  =  .10, 
s(x)  =  .258,  2(a/2)  =-1.645,  and  z(l-a/2)  =  1.645  (for  all 
calculations  see  Appendix  H) ;  =  .576,  A2  =  1.424.  The 

decision  rule  therefore  was; 

If  .576  £  X  £  1.424,  conclude  Hq  (y  =  1) ; 

If  X  <  .576  or  X  >  1.424,  conclude  (y  #  1) . 

Since  x  =  1.664,  the  decision  rule  led  to  conclusion  — 
that  the  price  estimates  of  overall  defined  order  cases 
au:e  not  accurate  (y  ^  1)  . 

Beta  is  the  probability  of  accepting  Hq  when  y, 
the  population  mean,  is  actually  equal  to  some  y^  other 
than  1.  For  this  analysis,  beta  is  evaluated  where  y^  was 
equal  to  the  sample  mean:  1.664.  To  determine  8,  the  proba¬ 
bility  of  a  Type  II  error,  the  equation  z  =  ^  was  used 

s(x) 

where  x  =  A2  (the  upper  limit  of  the  rejection  region). 


U  =  the  sample  mean  and  s(x)  =  the  standard  error  of  the 
Scunple  (9:174-176).  Calculating  the  z  value  we  obtained; 


-  -  .258  -  ' 

z(S)  =  -.9302; 

B  =  .1762. 

For  this  test  (where  a  =  .10,  B  =  .1762)  we  con¬ 
cluded  that  the  estimated  costs  of  cases  overall  are 
not  accurate. 

Stratified  Cases 

The  scimple  of  cases  drawn  from  the  population  of 
defined  order  cases  was  stratified  in  two  manners: 

(1)  by  source  of  estimate,  and  (2)  by  category  of  case 
(questions  3  and  4).  When  stratified,  a  mean  value  of  ACC 
could  be  calculated  for  each  stratum  and  used  to  test  the 
null  hypothesis  as  stated.  A  new  rejection  region  for  each 
stratum  was  calculated  using  the  standard  error  for  that 
stratum.  (The  a  level  =  .10  for  all  tests.)  When  strati¬ 
fied,  we  found  some  of  the  strata  could  not  be  tested 
because  of  insufficient  sample  size.  This  shortcoming  of 
the  study  was  a  result  of  the  population  definition  and 
original  sample  selection.  The  population  used  was  all 
defined  order  FMS  cases,  implemented  and  closed  during  the 
period  1976-1980.  These  cases  were  used  to  ensure  avail¬ 
able  and  current  data.  However,  although  the  population 


was  large,  some  strata  were  not  of  sufficient  size  to 
be  tested.  For  example,  "G"  cases  only  totaled  24  in  the 
entire  population.  Similarly,  "M"  cases  only  contained  26 
By  selecting  40  percent  of  the  entire  population,  the 
data  collection  was  reduced  to  a  manageable  effort.  Unfor 
tunately,  40  percent  of  some  strata  again  resulted  in 
stratum  sizes  too  small  to  be  tested.  For  example,  100 
percent  of  "C"  cases  =  61,  but  40  percent  sampling  of 
"C"  cases  =  25.  For  our  purposes,  if  the  sample  size  of 
the  stratum  was  less  than  30,  it  was  not  considered  suf¬ 
ficiently  large  enough  to  apply  the  Central  Limit  Theorem. 
Other  statistical  tests  for  small  samples  are  available 
but  were  not  used  because  the  results  of  such  tests  would 
be  much  less  conclusive  than  those  for  the  large  sample 
tests.  The  conclusions  made  using  numerous  small  sample 
tests  and  resulting  inferences  about  the  subpopulations 
would  be  unreliable. 

Table  4  indicates  only  those  strata  that  were 
tested.  Also  included  in  Table  4  are  the  standard  errors 
of  the  strata,  the  calculated  acceptance  regions,  the  mean 
values,  and  the  hypothesis  conclusions.  A  breakdown 
of  all  the  case  samples  and  statistics  is  contained  in 
Appendix  G. 

Research  Question  Number  3.  What  is  the  accuracy 
of  cost  estimates  by  source  of  estimate? 
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TABLE  4 

SUMMARY  OF  SAMPLES  TESTED 


Sample  Tested 


A, <x<A, 


f 

Overall ' 

.258 

• 

Ogden  (Source) 

.095 

• 

"A"  (Category)* 

.113 

• 

"L"  (Category)* 

.816 

576<x<1.424 

1.664 

844<x<1.156 

1.328 

814<x£l.l86 

1.275 

342<x<2.342 

2.086 

Conclude 

H, 


*Note:  "A"  cases  are  Ammunition;  ”L"  cases  are 
Equipment 


After  testing  the  hypothesis  for  the  accuracy  of 
the  cases  overall  the  sample  was  stratified  by  source  of 
the  estimated  costs  for  each  case.  The  source  of  the 
estimated  cost  falls  into  one  of  seven  possibilities. 

They  are:  (1)  Ogden  ALC;  (2)  Oklahoma  City  ALC;  (3)  Warner 
Robins  ALC;  (4)  Sacramento  ALC;  (5)  San  Antonio  ALC; 

(6)  International  Logistics  Center,  Wright-Patterson  AFB; 
and  (7)  Other  (2750  ABW,  AF  Clothing  &  Textile  Office, 
etc.).  Of  these  groupings  only  one  division  contained 
enough  elements  (n  ^  30)  to  be  used  to  test  the  null  hypo¬ 
thesis.  Ogden  ALC  contained  a  sample  size  of  72  vdiich  was 
sufficiently  large  to  apply  the  Central  Limit  Theorem  and 
do  the  statistical  testing  required.  As  indicated  in 
Table  4,  the  decision  rule  to  conclude  Hq  is  .844  £  x 
<  1.156.  For  this  sample,  x  =  1.328,  therefore  we 


concluded  that  the  estimated  costs  originating  at  Ogden 
ALC  are  not  accurate. 

Research  Question  Number  4.  What  is  the  accuracy 
of  cost  estimates  by  category  of  case? 

The  original  sample  of  176  defined  order  cases  was 
then  stratified  by  the  category  of  each  case.  The  cate¬ 
gories  are:  (1)  A,  (2)  B,  (3)  C,  (4)  G,  (5)  H,  (6)  L, 

(7)  M,  (8)  P,  (9)  V,  and  (10)  Other  (J,  W,  X,  Y,  N) .  Of 
these  ten  categories  only  two  had  sample  sizes  sufficiently 
large  to  apply  the  statistical  tests.  The  categories,  as 
indicated  in  Table  4,  are  the  "A"  cases,  n  =  37,  and  "L" 
cases,  n  =  47.  For  the  "A”  cases  the  acceptance  region  fo;. 
Hg  was  calculated  as  .814  £  x  £  1.186.  x  =  1.275  >  1.186 
therefore  we  concluded  that  the  accuracy  of  cost  esti¬ 
mates  for  "A"  cases  is  not  equal  to  1;  not  accurate. 

The  mecin  accuracy  of  "L"  cases  was  2.086.  This 
value  fell  within  the  acceptable  region  of  Hg  because  the 
calculated  acceptance  region  was  -.342  £  x  £  2.342.  (Be 
aware  that  it  was  not  possible  to  have  a  negative  value  for 
X  because  all  values  of  ACC  >  0.)  The  large  acceptance 
region  about  x  was  due  to  the  comparatively  high  standard 
error  of  the  sample:  .816.  The  standard  error  is  a  measure 
of  variability  in  the  sample  values  (10:201).  An  examina¬ 
tion  of  the  saitple  of  "L”  cases  revealed  that  one  case  did 
have  an  extremely  large  ACC  value:  39.373.  Consequently, 


for  the  subpopulation  of  ”L"  cases  we  concluded  Hq,  that 
the  cost  estimates  are  accurate  (y  =  1) . 

Research  Question  Number  5 

What  is  the  accuracy  of  cost  estimates  on  selected 
FMS  items?  Can  these  be  related  according  to  category  of 
case  or  price  estimating  source? 

The  unit  price  of  each  item  in  the  176  sample  cases 
was  recorded  and  then  grouped  into  price  ranges.  A  price 
range  of  $10.01  -  $70.00  was  selected  for  analysis  because 
this  range  contained  a  sufficiently  large  (n  =  108)  sample 
of  items.  The  price  range  with  the  highest  frequency  was 
expected  to  include  items  from  most  categories  of  cases 
cuid  from  most  estimating  sources.  By  selecting  as  narrow 
a  price  range  as  possible  we  expected  to  include  items 
that  were  handled  similarly  in  the  FMS  process;  i.e. , 

$10.01  -  $70.00  items  would  be  given  the  same  administra¬ 
tive  handling  (priorities  and  other  conditions  excepted) . 
This  sample  of  108  items  was  examined  to  gather  further 
information  about  the  accuracy  of  cost  estimates. 

The  value  for  the  accuracy  (ACC)  for  each  item  was 
computed  as  a  ratio  of  the  Estimated  Unit  Cost  (EUC) 
divided  by  the  Delivered  Unit  Cost  (DUC) .  The  value  for 
EUC  and  DUC  was  obtained  from  the  DD  Form  1513  and  the 
R058  report  respectively.  Similar  to  the  case  analysis, 
the  value  of  ACC  could  be  any  number  greater  than  0 .  Table  5 


TABLE  5 


PROPORTIONAL  BREAKDOWN  OF  SAMPLE  (ITEMS) 


Value  of  ACC 

n 

n/108 

ACC  <  1 

17 

.157 

ACC  =  1 

42 

.389 

ACC  >  1 

49 

.454 

TOTAL 

108 

1.00 

indicates  the  proportional  breakdown  of  the  sample  by  the 
individual  values  of  ACC.  This  breakdown  indicates  a  high 
proportion  of  the  accuracy  values  (38.9  percent)  equals 
exactly  1.  That  this  is  a  higher  percentage  than  the 
accuracy  of  cases  overall  (23.3  percent)  can  be  expected 
because  it  is  more  likely  that  the  price  of  a  single  item 
will  remain  constant  than  it  is  likely  that  the  price  of 
a  group  of  items  (such  as  a  case)  will  remain  constant. 

As  previously  determined,  an  acceptable  level  of 
accuracy  for  the  estimated  cost  is  ±10  percent  of  the 
delivered  cost.  The  sample  proportions  of  ACC  using  a 
±10  percent  acceptable  limit  are  displayed  in  Table  6. 
Clearly,  the  majority  (54.6  percent)  of  estimated  costs 
for  individual  items  fell  within  the  acceptable  range  of 
accuracy . 

To  deteinnine  the  accuracy  of  the  cost  estimates 
for  items  overall,  the  mean  value  of  ACC  was  used  as  the 
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TABLE  6 


PROPORTIONAL  BREAKDOWN  GIVEN  ±10  PERCENT 
ACCEPTABLE  ACCURACY  (ITEMS) 


Value  of  ACC 

n 

n/108 

ACC  <  .9 

10 

.093 

.9  <  ACC  <1.1 

59 

.546 

ACC  >1.1 

39 

.361 

TOTAL 

108 

1.00 

test  statistic  to  test  the  null  hypothesis.  Hq,  the  null 
hypothesis,  was  that  the  estinvates  of  costs  for  items  are 
accurate;  the  alternative,  Hj^,  was  that  the  estimates  are 
not  accurate.  That  is; 

Hq:  u  =  1,  estimated  costs  are  accurate; 

y  1,  estimated  costs  are  not  accurate. 

The  a  limit  for  this  statistical  test  was  again  established 
at  .10.  Using  the  SPSS  computer  program,  the  standard 
error  of  the  sample,  s(x),  equaled. 059.  The  decision  rule 
for  the  hypothesis  was: 

If  .903  £  X  £  1.097,  conclude  Hq; 

If  X  <  .903  or  X  <  1.097,  conclude  H^ . 

Since  X  =  1.153  for  the  sample,  we  concluded  H^^,  that  the 
estimated  costs  are  inaccurate  for  items  overall. 
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stratified  Items 


The  sample  of  items  from  the  defined  order  cases 
were  again  stratified  in  two  ways:  (1)  by  source  of  the 
estimated  cost,  and  (2)  by  the  category  of  the  item.  When 
stratified,  a  mean  value  of  ACC  was  computed  for  each 
stratum  and  used  to  test  the  null  hypothesis.  For  each 
stratum  a  new  rejection  region  was  calculated  using  the 
standard  error  for  that  sample.  Just  as  some  strata  of 
the  cases  could  not  be  tested  using  the  Central  Limit 
Theorem,  some  of  the  stratified  samples  of  items  could  not 
be  tested  because  their  sample  size  was  not  sufficiently 
large  (n  ^  30) .  Table  7  is  a  breakdown  of  the  strata 
tested,  their  standard  errors,  acceptance  regions,  mean  ACC 
values,  and  the  hypothesis  conclusions.  A  breakdown  of  all 
the  item  samples  and  statistics  is  given  in  Appendix  G. 


TABLE  7 

SUMMARY  OF  SAMPLES  TESTED  (ITEMS) 


Sample  Tested 

s(x) 

Ai<i<A2 

X 

Conclusion 
«0  «1 

Overall 

.059 

.903<x<1.097 

1.153 

X 

Ogden  (Source) 

.089 

.854<x<1.146 

1.159 

X 

"B"  (Category)* 

.056 

.908_<x<1.092 

1.123 

X 

"L"  (Category)* 

.025 

.959<x<1.041 

1.050 

X 

*Note : 

"B"  cases 

are  Spares;  "L" 

cases  are  Equip- 

ment . 
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Items  by  Source.  When  stratified  by  source  of  the 
cost  estimates,  only  one  san5>le  was  sufficiently  large  to 
test  the  null  hypothesis.  The  stratum  of  items  vdiich  had 
Ogden  ALC  as  a  source  of  estimate  contained  a  sufficiently 
large  sample  size  of  items,  (n  =  42) ,  to  apply  the  Central 
Limit  Theorem  and  assume  a  normal  distribution  of  the  value 
for  ACC.  Table  7  shows  the  decision  rule  to  include  Hq 
was  .8  54  _<  X  £  1.146.  Since  x  =  1.159  for  this  sample, 
we  rejected  Hq  and  concluded  that  the  estimated  costs  are 
not  accurate. 

Items  by  Category.  The  sample  of  108  items  was 
stratified  by  the  categories  of  items.  There  are  ten 
possible  categories  into  vrtiich  the  items  may  fall  (A,  B,  C, 
G,  H,  L,  M,  P,  V,  Other);  however,  when  divided  by  cate¬ 
gory  the  items  fell  in  only  five  categories:  A,  B,  C,  L, 

V.  Of  the  five  categories  represented,  only  two  contained 
samples  sufficiently  large  enough  to  be  tested — B  and  L. 

The  categories  B  and  L  contained  34  and  33  items  in  their 
samples,  respectively. 

Table  7  indicates  the  two  categories  tested  and 
the  calculated  acceptance  regions.  For  the  items  in  cate¬ 
gory  B  cases,  the  acceptance  region  to  conclude  Hq  was 
.908  £  X  £  1.092.  The  mean  ACC,  x,  for  the  sample  equaled 
1.123.  X  =  1.123  >  1.092,  therefore  we  rejected  Hq  and 


concluded  ,  that  the  estimated  costs  of  items  from  $10.01 
to  $70.00,  for  B  cases,  are  not  accurate. 

The  computed  mean  accuracy  of  items  in  category  L 
cases  was  1.050.  The  calculated  acceptance  region  for  Hq 
was  .959  £  X  £  1.041.  For  the  sample  of  items  x  =  1.050 
>  1.041,  therefore  we  again  rejected  Hq  and  concluded 
For  this  sample  we  concluded  that  the  estimated  costs  are 


not  accurate. 


CHAPTER  IV 


CONCLUSIONS 

The  intent  of  this  study  was  to  support  or  dismiss 
the  perception  that  FMS  price  estimates  are  inaccurate. 

The  scope  was  limited  to  include  only  defined  order  cases 
managed  by  AFLC,  excluding  systems  sales  and  CLSSA  programs. 
This  chapter  concludes  the  report  of  this  study  and  pre¬ 
sents  the  findings  answering  each  research  question.  Also 
included  are  recommendations  for  possible  management 
investigation  and  areas  for  further  research  based  on  the 
findings . 

Findings 

Research  Question  1 .  What  is  an  acceptable  level 
of  accuracy  for  the  estimated  costs? 

Both  AFLC  and  foreign  representatives  expressed 
the  opinion  that  an  estimated  price  that  came  within  +10 
percent  of  the  delivered  cost  would  be  acceptably  accurate. 

Research  Question  2.  What  is  the  accuracy  of  cost 
estimates  for  FMS  cases  overall? 

The  mean  accuracy  of  the  sample  was  1.664.  This 
value  indicates  that  prices  for  material  value  are  over¬ 
estimated  in  comparison  to  the  final  delivered  value 


(ACC  =  =  1.664).  The  statistical  testing  concluded 

that  price  estimates  for  defined  order  cases  overall  are 
inaccurate.  Research  indicated  the  inaccuracy  tends 
towards  overestimating  prices. 

Research  Question  3.  What  is  the  accuracy  of  cost 
estimates  by  source  of  estimate? 

When  the  sample  of  176  cases  was  stratified  accord¬ 
ing  to  the  sources  of  price  estimates,  only  the  stratum  of 
cases  estimated  by  Ogden  ALC  contained  a  sufficient  number 
of  cases  to  allow  statistical  testing.  The  mean  accuracy 
of  the  cases  estimated  by  Ogden  was  1.328.  As  it  was  for 
the  cases  overall,  the  case  values  estimated  by  Ogden  ALC 
tend  to  be  overestimated.  The  statistical  test  indicated 
that  the  estimated  costs  on  defined  order  cases  from  Ogden 
ALC  are  inaccurate. 


Research  Question  4.  What  is  the  accuracy  of  cost 
estimates  by  category  of  case? 

When  the  seunple  of  cases  was  stratified  by  cate¬ 
gory  of  case,  only  two  categories,  "A"  and  "L",  contained 
sufficient  numbers  of  cases  to  analyze.  The  mean  accu¬ 
racy  for  "A"  cases  was  1.275.  This  was  found  to  indi¬ 
cate  that  estimates  for  "A"  cases  are  inaccurate  and 
overestimated.  The  mean  accuracy  for  "L"  cases  was  2.086. 
The  estimated  costs  for  these  cases  were  found  to  be 
accurate.  However,  the  resulting  conclusion  for  the  "L" 
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cases  was  a  result  of  the  standard  error  for  this  stratum 
which  at  .816  was  a  relatively  large  figure.  This  large 
standard  error  was  a  reflection  of  an  extreme  deviation  in 
the  sample  data.  Consequently,  this  conclusion  may  be  less 
valid  than  the  others  in  this  study. 

Research  Question  5.  What  is  the  accuracy  of  cost 
estimates  on  selected  FMS  items?  Can  these  be  related 
according  to  the  category  of  case  or  the  price  estimating 
source? 

Statistical  testing  of  the  mean  accuracy  of  the 
estimated  costs  of  the  items  concluded  that  the  estimates 
are  inaccurate.  When  the  sample  of  selected  items  was 
stratified  according  to  the  category  of  case  on  which  they 
had  been  purchased,  only  category  "B"  and  "L"  cases  had 
sufficient  data  for  analysis.  The  accuracies  of  "B"  cases 
and  "L"  cases  were  both  found  to  indicate  inaccurate  price 
estimates.  When  the  items  were  stratified  by  source  of 
estimate,  only  the  stratum  of  items  estimated  by  Ogden  ALC 
had  a  sufficient  amount  of  data  for  einalysis.  Again,  the 
cost  estimates  were  found  to  be  inaccurate.  All  estimated 
costs  for  items,  both  stratified  and  taken  as  a  whole,  are 
overestimated . 

Conclusions 

The  research  objective  of  this  thesis  was  to  deter¬ 
mine  the  accuracy  of  price  estimates  given  to  foreign 


customers  by  AFLC  for  defined  order  FMS  cases.  This 
research  was  motivated  by  the  need  to  substantiate  common 
perceptions  of  price  estimating  performance.  This  research 
indicated  that  the  mean  accuracy  of  price  estimates  given 
to  foreign  customers  by  AFLC  for  defined  order  FMS  cases 
was  1.664  or  that  the  estimated  cost  was  166.4  percent  of 
the  final  delivered  value.  This  shows  that  AFLC  over¬ 
estimated  costs  on  defined  order  cases.  Further,  except 
for  the  sample  of  cases  in  category  "L" ,  each  test  in  this 
study  concluded  that  estimated  costs  were  inaccurate  and 
had  in  fact  been  overestimated.  A  look  at  the  proportions 
of  cases  and  items  vdiich  were  accurate,  overestimated, 
or  underestimated  confirmed  that  overestimated  cases  and 
items  constituted  a  significant  part  of  the  samples  and  by 
inference,  the  population.  Based  on  this  study,  under¬ 
estimating  prices  for  defined  order  FMS  cases  may  not  be 
a  serious  problem  for  AFLC.  However,  underestimates  were 
made.  It  was  outside  the  scope  of  this  study  to  evaluate 
the  logistical,  financial,  or  memagement  problems  resulting 
from  those  underestimated  cases.  It  may  be  that  this  small 
proportion  of  cases  could  have  caused  a  disproportionate 
amount  of  trouble  for  FMS  managers  and  purchasers.  Whether 
or  not  the  overestimated  cases  caused  problems  for  the 
Purchaser  would  depend  on  the  country  involved.  In  talk¬ 
ing  to  people  who  work  with  FMS  programs,  one  could  con¬ 
clude  that  eui  overestimated  case,  especially  one  that  was 


within  +10  percent  of  the  final  value,  was  not  viewed  as  a 
major  management  problem  for  the  Purchaser. 

Recommendations  and  Areas  for 
Further  Research 

One  recommendation  which  can  be  made  as  a  result 
of  this  study  is  that  the  International  Logistics  Center 
(ILC)  look  into  the  feasibility  of  monitoring  on  a  con¬ 
tinuing  basis  the  relationship  between  the  estimated  and 
delivered  values  of  FMS  cases.  The  data  is  readily  avail¬ 
able  and  the  information  generated  would  give  FMS  managers 
and  policy  makers  a  timely  indicator  of  performance.  The 
information  would  also  show  when  price  estimating  pro¬ 
cedures  should  be  adjusted  to  meet  changing  conditions. 
Having  this  information  would  also  allow  FMS  managers  to 
respond  to  customers'  perceptions  of  price  estimate  accu¬ 
racy. 

Another  recommendation  is  that  price  estimating 
procedures  be  given  a  thorough  and  critical  review  by  HQ 
AFLC  with  the  purpose  of  incorporating  what  is  now  known 
through  resecirch  and  the  experience  of  AFLC  and  ILC  manage¬ 
ment  about  ways  to  make  price  estimates  more  accurate. 
Although  it  may  not  be  possible  to  make  exact  price  esti¬ 
mates,  amy  effort  to  improve  accuracy  will  help  lessen  the 
management  problems  now  being  experienced  by  both  the  ILC 
and  foreign  country  managers  of  FMS  programs  when  price 
estimates  prove  to  be  inaccurate. 
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During  the  course  of  this  research  effort  several 
cireas  for  further  research  were  identified.  Among  these 
were  the  following: 

1.  This  study  could  be  repeated,  redefining  the 
population  to  insure  a  sufficiently  large  sample  in  each 
case  category  or  for  each  source  of  estimate.  This  would 
allow  a  comparative  analysis  of  these  subpopulations  that 
was  not  possible  in  this  thesis. 

2.  The  sale  of  weapon  systems  with  associated 
support  is  an  important  aspect  of  FMS  vdiich  was  not 
addressed  in  this  thesis.  Considering  the  high  cost  and 
political  importance  of  these  sales,  a  study  of  price  esti 
mate  accuracy  for  systems  cases  would  be  of  great  interest 

3.  Among  the  factors  believed  to  impact  the  accu¬ 
racy  of  price  estimates,  the  appropriateness  of  the  infla¬ 
tion  factor  used  was  frequently  mentioned.  Research  in 
this  area  may  be  of  benefit  to  AFLC  when  revising  FMS  pro¬ 
cedures  . 

4.  Some  people  working  in  AFLC  believe  that  price 
estimates  can  be  improved  by  retrieving  and  reviewing  cur¬ 
rent  cost  information  which  is  now  available  to  FMS  mana¬ 
gers  through  the  information  systems  which  record  FMS 
deliveries.  It  would  be  useful  to  determine  the  feasi¬ 
bility  of  providing  price  estimating  support  through  these 
existing  systems. 


Due  to  the  variety  of  articles  and  services  avail¬ 
able  and  the  number  of  purchasers  participating  in  FMS 
cases  [the]  system  identifies  the  purchaser  and  the 
material  or  services  being  sold  [26:4-1], 

The  U.S.  Air  Force  FMS  case  identifier  is  made  up  of  a 
two-digit  alphanumeric  code  for  the  purchasing  country  or 
organization  followed  by  a  dash  and  the  U.S.  Air  Force 
Service  Code  -  "D".  This  is  followed  by  a  dash  and  a 
three-letter  case  designator.  A  typical  FMS  case  identi¬ 
fier  could  be:  AT-D-AAB.  "AT"  is  the  country  code  that 
identifies  the  purchaser — in  this  case,  Australia.  The 
letter  "D"  is  used  for  all  USAF-managed  FMS  cases  (U.S. 

Army  uses  service  code  "B" ,  U.S.  Navy  uses  service  code 
"P") .  The  first  position  of  the  three-letter  case  desig¬ 
nator  identifies  the  category  of  material  or  services  pur¬ 
chased  on  the  case.  The  second  and  third  positions  are 
used  to  identify  one  case  from  another  within  the  same 
category  and  for  the  same  purchaser  (26:4-2).  In  the 
example,  the  first  "A"  of  the  designator  identifies  the 
category  as  munitions,  the  last  two  letters  indicate  that 
this  is  the  second  munitions  case  established  for  Australia. 
(The  first  case  would  have  been  AT-D-AAA,  the  third  case 
would  be  AT-D-AAC)  (26:4-2). 


The  following  is  a  list  of  codes  used  in  the  first 
position  of  the  case  designator  to  identify  the  categories 
of  items  or  services  included  in  the  case.  The  letters 
I,  O,  and  Q  are  not  used  (26:4-1  to  4-8). 


Notes 


*  Defined  Order  case  included  in  the  population  of 
this  study. 

**Can  be  either  Defined  Order  or  Blanket  Order 
Case.  It  is  included  in  the  population  of  this  study  if 
it  is  a  Defined  Order  case. 

No  asterisk  indicates  Blanket  Order  Case.  Not 
included  in  the  population. 


*  A 

*  B 

*  C 

*  D 

E 

*  F 

**  G 

*  H 

*  J 
K 

*  L 
**  M 

**  jj 


Munitions 
Spare  parts 

Cartridge  Actuated  Devices  and  Propellant  Actuated 
Devices  (CAD/PAD) 

Systems  Sales  of  Communications,  Electromagnetic, 
Meteorological  facilities  (CEM) 

Support  Equipment  (previously  designated  as  an 
"LX_"  case) 

Training  Films  and  film  strips 

Technical  services 

Transportation  services 

Aircraft  ferry  services 

Follow-on  spares  support  under  CLSSA 

Equipment 

Programmed  depot  and  emergency  repair,  overhaul, 
and  return  of  major  items 

Follow-on  engineering  support 
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**  P  -  Publications 


R  -  Spare  parts  (Blanket  Order  Case) 

S  -  Aircraft  system  sales 
**  T  -  Training 

*  U  -  Reserves 

**  V  -  Class  IV  modifications 

*  W  -  Class  V  modific:itions 

X  -  Trust  Fund  Account  (not  an  FMS  case) 

*  Y  -  System  sale  (other  than  aircraft  or  CEM) 

*  Z  -  Leases  under  Title  10  OSC  2667  (not  an  FMS  case) 
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APPENDIX  B 
ESTIMATED  COST 


54 


In  accordance  with  AFR  400-3,  Block  21  of  the 
DD  Form  1513  is  the  "estimated  articles  and  services  costs 
in  whole  dollars  [26:6-261."  This  figure  includes  all 
direct  charges  and  should  not  include  administration  or 
accessorial  charges.  This  cost  is  used  in  the  study  unless 
DD  Forms  1513-1  or  1513-2  have  been  issued. 

The  DD  Form  1513-1  is  the  document  used  for  certain 
bilateral  amendments  to  FMS  cases.  It  is  used  to  reflect 
small  changes  in  scope  when  it  would  be  impractical  to 
process  a  new  DD  Form  1513.  For  example,  minor  increases 
in  the  quantity  of  an  item  ordered  on  a  defined  order  case, 
or  increases  in  the  time  of  performance  which  result  in 
increased  cost  would  both  be  processed  using  a  DD  Form 
1513-1.  An  amended  cost  estimate,  if  different  from  that 
given  on  the  original  DD  Form  1513,  is  reflected  in  Block 
22b  of  the  DD  Form  1513-1.  In  this  study,  the  amended  cost 
estimate  will  be  used  in  lieu  of  the  original  DD  Form  1513 
estimate. 

A  DD  Form  1513-2  is  used  for  unilateral  notices  of 
actions  under  existing  LOA  conditions  and  for  certain 
bilateral  actions  as  authorized  by  MASM,  Part  III  (26:6-38). 
If  the  DD  Form  1513-2  is  issued  because  of  item  cancella¬ 
tion  or  quantity  reduction,  the  Revised  Cost  given  in 
Block  19b  of  the  DD  Form  1513-2  will  be  used  in  place  of 
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the  original  estimate.  If  the  DOD  Form  1513-2  is  issued 
for  any  other  reason,  the  Revised  Cost  will  not  be  used. 


APPENDIX  C 

DD  FORMS  1513,  1513-1,  AND  1513-2 
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UNITED  STATES  DEPARTMENT  OF  DEFENSE 
OFFER  AND  ACCEPTANCE 


III  PURCHASER  fUttmt  tmi  AAOral  t£tp  Codrf 


gsneral  conditions 


A.  THC  OOVCRNMiNT  Of  TMC  UMITXO  STAfCS. 

I  In  (ufNtkii  AUkti  ii(in«  ttftm  ii«  0<owtm<ftt  of  OettiM*  chrtfiitodir  tefmcd  In  at  “OOD**I  .mta*  wM  moiirctt.  or  in  prncui* 

in«n  wndcr  larmt  anU  c'M'.oicnt  »-tn  OOU  <«*«lai>uiH  tA«l  i«rnc«dur^  *ntii  p«>«currni;  for  Ihr  f'lviiiasvr.  ir.r  OOO  .naa.  in  aanaraf 

ctnoloT  in*  win*  confraci  cUutn.  iM  tauM  cnnrtact  saAMitraiiMi.  anJ  :n*  omt  intrtciion  rrocrdurvi  s»  «knwM  n<  vwd  ii  rrncwnnf  for  kmiI. 
««c<p(  i\  o<n«n*u«  r>.<4uc4i«d  nv  ih«  (’•jrci.atcr  a*«l  a«  atdrM  lu  •»  iM  HOD.  CntaM  in«  puicnatar  ha*  rrM-i«M«'i  itnl  >  v>i«  Mitirca  cinirarior 
Jatttnaiad.  jiM  inta  L«li«r  <j(  Ulftr  and  Acccotaira  rriUcii  ■ccaptaAca  of  «ukii  «Mli<nti«»n  i*-*  ifta  DCO.  ih*  rurclia*«r  ondaniirMit  tliai  tattciion 
of  (Ik  rontvastnr  Mittrc*  in  nil  (Dm  raoturamaiii  it  «uta!«  ilM  naonAtiniiii-  of  in«  Oo-.amnMAt  of  uia  Uoiud  S'aiM  lli>.-r»inaii#r  f*l»rf*«  M  m  -*CSC’'). 
furtnat.  tn*  fwcHAMr  aann  inu  iha  L'ntwd  Siaiat  OaOta  miwy  rvaooAafela  (or  MfOuaikAg  iB*  l•rllla  aM  condiiiOAt  of  ail  cnAUMW  Atmaam  to 
fulldl  ilM  r*owtr«(A«AU  in  tna  Zrfitar  ui  Of(*r 

2.  A4««^»t  >«t(an  ilw  DOO  i»«Kwrrt  i««r  imif.  tit  cer»tta<it  iacI;<J«  warraniv  iljuwt  ••aI»  on  m  riarpiMnal  Mtis.  lloA'ctaT.  tk« 

use  Uiall  with  ivtp-ci  I'*'  nrocitrad.  and  wr>»M  tiAaiv  mtic*  aimmpi  iti  iha  aairnt  p^-itibla  lo  umain  4Av  particyUr  or  tMCiai  cnn> 

iiasi  fft'Srtion^  anti  wamnitr*  tiviirv-j  n*  tn«  i*urcna««r.  r**#  USO  "nintr  agrart  m  atafcMa.  apon  tfia  Hyriit.itkr  i  raoaett,  an*  rtiiAit  (tncujirr 
fn»M  wmiif  uniJar  an*  tvvrantia^t  ina  L SC  mat  nave  onJar  ant  ennuart  conuaviad  witn  ina  rroiurrmani  of  »o«  iiamt.  Ant  additional  cou 
.'VkultiiK  from  ■•MatniAa  twa<:ial  tnnica«(  pr««it>M'nt  <>«  tt^mniiai.  or  iak  atarcitr  of  r«iA«  tiiijrr  tucH  pr»*i»ioni  ut  nairantwt.  or  ant  oilitr  riaiiil 
iliai  ii.a  use  i^at  Aata  undar  ant  ^nnitaci  KOAnactaJ  miA  in*  prt>c«ira%cnt  of  urmt.  .lull  *'a  ;ii.<rrrJ  (o  iha  Pur«iUkar 

].a.  SKail.  tinka  Ilia  a  jntJiiion  tt  otAarKit#  tpaitfiail  iK*«m  ir  g..  “  Aa  it  I.  icpav  or  taplaea  ai  n<>  rtira  koat  IrfriiM  ariKlaA  toppbrJ  from 
noO  tiixht  wnirn  .iir  oaoijraJ  m  rounJ  1*1  na  dafaviitr  ia  rvtpact  n#  maianal  or  Mnrhmanthie.  iitiiaA  it  it  rtianlitfirJ  I'li  rrirta  tlrrirrancin  rartrad 
prior  in  patAita  ‘»t  liila.  f.iuRo  i«i  Pa  Jrfaciita  ia  daugn  lu  tucO  a  Jearao  mat  iha  >tvm»  ^anniM  ha  -itad  ai  iil  f-ir  ihc  iiarpeta  for  nhKH  (Hat 
•at*  dniaAva.  Onaii^irJ  r»f»«taniaii*at  •*»  ina  «  Sli  ano  of  riK  i*iirclu«aa.  upon  Anttlikainin  poituaAi  to  paragraph  ft  0  PHoh.  tnall  agr««  lAa 
iMttiliiy  of  in«  (.'Sii  haratiRdar  aint  ina  corraciita  tiapt  10  takao 

n  vti|ii  mra'‘i  III  ifamt  naing  pmruraU  foa  tala  10  tUt  ftirrSatar.  ilia  IfSU  aytaat  10  rtatcita  warrannat  Krhalf  of  ifta  furctiMar  our* 
tuaAi  in  .V2.  a6u«a  le  ataura.  10  iha  atcaot  providau  n«  ttia  o'MnAit.  raplacamtAt  or  cmtactioA  of  tUkli  ilairt  found  10  Pa  dafaeti«a. 

c.  (ft  addiiuin.  (ha  f,  SC  uirrantt  ina  tula  nf  all  itamt  toM  to  tn#  f-atchatat  hartundar.  Fha  L'SC.  h'>ntvar.  makrt  no  oartantMt  oiAar 
(han  iniAv  ^pacificaiiv  tri  fnrtK  harain.  !a  pariKuUr  iPa  UiC  dit^Lanna  ant  liapiljt*  ratuliinf  from  paUtti  tniringrin-.-ni  occataonad  py  Iha  um  or 
maiiufaciura  n»  <•!  (nr  PurciaMr  ouiiada  ina  Cnnad  Siaiat  of  itamt  iuppMtl  haraunoat 

*  .Adraat  m  Jrlivrr  and  patv  iiiia  10  ina  tiama  m  in#  futahjKt  ai  ihr  miiial  puini  of  thipmini  unlatt  mharAita  iprciriad  m  ihit  Offar 
artd  Accvpianca  wuh  laipati  lo  defanta  atiickt  pr.Kurad  f«»f  tala  m  ina  Ptdchatat.  ini»  mil  narmalti'  Ca  »  IIK  Rtanuiaciurait’  koadinp  (aciiiliat. 
mih  iktraci  10  JafaAta  inuU-t  lurnithaJ  irnm  tiocnt.  ihn  ndl  nnrmotlv  *»a  ai  iha  ti.S  oapiit  Aitulat  wdl  ha  rarkad.  cniad  «»  othartfa  paaparrJ 
fnr  ilhPAiant  rnra  10  tnv  iipta  iitia  pattav  If  “IVuni  i-f  t>aliva*t'*  ■*  «pact(«ad  ••ihaata-ita  in*n  iha  inuwl  pnini  ui  tnipmant  iha  torortma  'lilitart 
Oavanmani  or  Oafanta  -taanat  kiU  arvana#  rnotamani  of  ihaicania  to  Jia  auinentad  daPvarv  poini  *•  r*.mptinabia  laraiaa  Pui  mil  paM  nut  at 
Iha  iiutiai  pniAi  of  ihipmant.  (ha  CStt  ditcuimt  anv  uambt*  lor  oamaaa  or  lota  to  tha  iirma  .nawnad  altar  panap^  a»  ttUc  iTTatpaauKa  of  mnaint* 
trantwaruitoA  •«  nv  aommnn  ramar  or  nr  iha  U.S.  Oafanaa  rmnaponatieo  Svtiam 

J  .AJtitat  Uui  a  L'Alau  oihantita  tpaaiiiad.  USG  iiandard  iiamt  mil  pa  fornnhad  niihoui  ragorj  to  maha  fo  mitJae 

h  Thr  fOK*  (»f  (irmt  (o  ha  m'Kurrd  ibill  fra  at  iha»  total  koai  to  iht  USC  Lnlat*  oincrwyw  tpaciiicJ.  (ha  iruti  ritmuiat  of  itcmt  19  Pa 

^meurad.  a«aiiadilii<  daiaroKAiitoA.  pa^mani  t^mdofa.  aod  dv|f«a*v  pmiactioht  outMti  art  miimairt  hatad  on  L-urrrni  a^aiiania  iata  Tha  fSC  will 
^  •>>  heu  ailixit  10  ad^isr  ihr  Puicnatar  or  itt  aiHnntiaad  ragrrarntaiitat  bt  DO  Form  I  SI  2-2 

(II  -'f  an*  MlaAiilwhta  cow  (Acraatr  mat  nugm  ratolt  m  an  mertma  m  iha  “Eanmaird  Total  C.»tii  m  ctcatt  of  10  parcani. 

(21  nf  ah'  than  gat  in  iha  pavmaAi  a«nadula«tl.  and 

(31  (if  3A«  daiatt  nhkh  (Ai(hr  M.-ntficanilt  affact  iha  aviimaiad  daitiari  dairt: 
lit  ftilura  ((^  to  rd«bt  ><f  (ha  rfrova  thall  noil  affavi  (ha  Furchawa't  uhlipaiion  unJtr  para^apht  ft  I  and  ft  3  Palow 

(.  Tha  I  SC  '<•  i((.  hoKata*.  oia  nt  iKti  affnrit  to  dactat  iiamt  or  randaa  tamert  fnr  iha  amnoni  aivi  ai  iha  iimat  duuttd. 

fr  '.(Alar  laniatual  and  rnmfalliAa  «iri;uin«ia(i(at  kIhmi  ina  ita(ion*|  miartti  »f  tha  Cmiad  Siaia*  »**  rrowif**.  !■»«  LSI*,  letarvai  riia  rifhi  ip 

konkal  or  toipanJ  all  -'r  pire  of  «n(»  0(1.^  md  Aitamncaai  any  tuna  orv-r  t..  iha  dainm  nl  dclanta  ailKlat  nr  (H-rlurmanca  (•!  vrnaat  (intlodmr 
rraidihai  f^a  '  pC.  >(<a(f  »■«  fk«poAiiMa  I'x  ail  iirniination  kiriit  of  topuhart  ratitlling  jrom  kaneriUlion*  or  tuU'aiKUiht  anJar  ihii  pafatfaph- 
y  Shall  rviund  lu  rna  Purkfwraf  a«»  p-aimanit  raaaikad  hcrawnjar  nhnh  prnia  :n  na  ii.  aterta  •>>  tha  iihal  i:>iai  k-**i  nf  driitrr'  and 
loridrntihia  <.i  Ihit  (lllai  and  AccarUiwr.  ami  Ka  a.m  radoirvo  in  vtftat  arrtaragat  •*«  olhar  opan  ilffart  rod  Avkapfai'krt  i.t  lha  Piirkhatar 

a  Ad«Kat  ihji  partoAnal  iKif‘<rmin«  d.‘t<n«a  taav<v-r«  ra«i«idaJ  ondai  Ihit  f>ifar  and  Accrrianva  kiU  noi  parform  am  doi»t  nl  a  ki*m» 
hjiani  Atiura.  ii«iudii'i  an*  JwiKt  ralaiing  in  irainnig  adtitiA«  ,0  ■iiAafttna  prondma  atMtianva  rrparilrng  kiimhai  ariiauiat.  xwitioa  tha  Lniiad 
Siatat  III  konna^iK'A  niit>  Cia  arrformin<,a  <.f  *iK«a  d«ianta  tvrtik-at. 

P.  \dvwat  ihji  in  iha  a«tArnm.in(  «r  «rtpl.»t(naRi  .'f  t'Riiad  Slaiat  partohnal  l.ir  iha  partnrmanck  •»(  tn»»  Ollri  and  AkCaiMama.  iha  '.'SC 
Mil  n«ii  laka  <n«(i  tcvouni  laaa.  laliainn.  naiumtl  -aiatn  •>t  tat. 

10.  tdvi.at  (I'ji  n<<it*ii;tfundiiia  Pixthatar »  apraani«nt  i*.  pa*  miarati  «»n  an*  nai  amount  hv  tkhxh  Piiiki.akar  ma*  ha  lA  atraart  on  pa»- 
<at  ia(i*Alad  (•>*  .n  rarafraph  6.3.4  hal*.**».  I  SC  f*indt  *kOl  ao«  t»a  utad  lor  Jikhwrtrmanit  P*  UOt' m  i«t  *.»nifak'itft  m  iha  aaani  *f  an* 
iuit  arrrart  .11  ritmani*.  tk,-irdin<l«.  (aiidra  h*  iha  I'orcnatar  t**  mata  timrly  (>a*n*<nit  -h  ih*  amount*  .iur  ma»  fr*all  ti>  Jria>t  in  k^niUki  rar* 
f<.rm.ii(ic  "*  IXJII  kMi.iravlxi-  kiaim*  P*  coAirKi«x«  i-a  iAcrco<ad  k(*ti*  timlwding  iha  an.ivr  mantutnad  mf*ri'*i  ki>«lkl.  claimt  P*  auniract.at  i..r 
icrminaimn  l.ahilii*  f-ii  Praakn  .n  vmiraci  '.r  lafmiiitiH.n  •»!  contra*.i>  P»  iha  USC  ondar  ihit  or  nii,*r  .pan  I'liwf*  and  AkcrpiaiKrt  ol  tha  P.achataa 
ai  I'itf»h4*ar't  k-Tpcnia. 

e.  THE  PURCHASER 

I  Shall  pa*  to  tha  USlJ  the  inial  »v«l  to  iha  I'SC  nf  iha  iirm*.  a*a»»  if  Ihr  final  Iwial  roti  atcaad*  tha  i(Af*'ini»  rkiimaiad  m  ihit  Offa* 
jod  Atik-piinca. 

2.  Shall  iTdt«  pa«m«n(|*  t  for  iha  iiamt  n*  vnaakftl  or  b*  <»ita  irantfar  pnaanta  m  Cnnrd  Piaiat  dollar*  to  Iha  Traatwrf  (*i  tha  I'niiad 

Si.iir*. 

1  j.  Sn..(f  ((  "TaTm*  ■  <ra*ii'  "k  lan  **»ih  maaptanca  *.  f.a«*-ard  **»th  thit  (Xfar  and  .Actapianca  a  khaik  «*r  **tr»'  trat**far  w  iha  fun  amouAt 
khiio’ii  ■«  (hr  a*inii  ii.'.l  l■l(al  C(**(.  and  jar.’a*  tn  nuba  *i»*,h  ^djHMinal  pr>maiitf*l  it  ma*  ha  ipaciliad  upon  H<HiiHrt*«>n  of  pi*m  McfaMattt  and 
KOUV'IOI  "rt  iwnJ*  |>.  kiik«r  lukli  inrrraaa* 

h  Aartat  It  **r«rm»‘’  *pk*kif«ri  patmani  («•  ha  "ca^h  rrmr  t»»  datoar*'*  in  ptv  «.*  iha  L’SO  loth  tm.iun;*  «i  tukh  limat  a*  ma*  hr  kpaciiiad 
fr«.'ii  iinir  (•■  (iiiir  h»  iiu  CMi  (inkiu.h.ia  •••»  ■.a.ji  dapowi  wi  t.»rth  nnoar  ”  fariw.  't  m  .ndar  it<  (»wai  ra*n.*iii  rr  iurainani*  i.*i  Hticlat  or  *ar*KBt 
i«i  hr  (  ifi'ikhrd  ir<iiii  (IK  (rv-ur\a*  «t  iha  i-S  itap»*tpia«i  nf  (ivu-nva.  I  Sli  laouati*  i<w  tundt  ina*  ha  r'a*ad  •11  •tiimaiad  raiiuiran*rAtt  lo  .o«ar  l.aa» 
ka*lad  li*aiK»  ..I  ariuKt .«  ki.kt  to  pf*«ta  datan*«-  u-r«Haa.  M  i«  I.  SO  pot**;*  •*»  efriam  tomi*  **9  da*»  m  aJvaAkr  ol  iha  iima  HOI)  ,'tant  toch 
aalikarir*  or  iioio*  to«h  r»pan*at  hat  ill  .n  eha  l'«tr«Matar. 

k  Orrat.  if  ■•Tarni*  <pakii*  |•a*mrAl  n*  "-lar*andahia  oAkiartaAmg  *  t«*  pa*  iir  iha  CSO  «*Kh  amnnntt  at  toth  iimat  at  ma*  ha  trakifWd 

from  iiinr  io  ni'w  Pv  ilia  L'AC  (l■•*ia.hn•  an-  ••••ml  •lamr*H  ta»  tioth  Mn-ia*  '  farA.t"*  in  oidai  to  'haai  patmanit  taauirad  P*  .uHtrikl*  anjat  *."iKh 

.trn.i  jra  haina  |•«..kllr•d.  j«d  an*  -la'Rarat  and  .-•*«  ina«  .na*  a«arvr.  ‘i  ha*a  •acrwa.l.  irnm  ikimiiuiiini  til  koi.iracu  h>  Iha  L’Mi  hakauta  if 
Piaktia*ar  »  kotikaiiiiioii  ••(  ritit  infrr  and  Avkai'ianta  undar  pararrapn  w.*.  i-arataf.  t  s*#  tk'ouatit  for  lund*  ma*  ha  haiad  uitm  atainiaiad  irnoira* 
mant)  (  n  jd.anta  .i.l  rr<«ri**  i*»»(iKne*  *uct.|i-rt.  ailimatad  ta»*ninaih»n  l.al.ilMk  jah*ar*  ItWrcadt  of  r*idaiKr  kit  *i>ntllOkit*a  oahvar*  a*  il*a 
ka*a  ru*  ha.  It  k  (.m.  (•oiii  1  i..  •miani  vKh  lunot  '»d  da*v  in  ad*an*a  oi  tha  lima  tSC  itukrt  pa>m<nit  (*a  hahall  ti  ihr  rurchaMt. 

1.  *rrr«*.  .1  '  Irfiiu  '  »|'«k'ir«  "(r»*fna*i'  «•  •la(i*ar>‘*  ihof  hdH  may  ha  J*iad  a»  of  Iha  daiati)  ‘if  dalnat*  nf  iha  Jaftnaa  aiiK'lat  o*  tandar* 

■na  i.i  Iha  <la(an«k-  kcrvKvt,  ut  gpn«  iViravati*  mI  ma  iaiafti  ihatanf 


*•'  ^  'fiar*.  <r  "farm**  iparii*  paamant  unoar  1  Cradn  Adraamtnt  hai**arn  ina  Pirahatar  and  1*00.  lo  pa*  to  tha  USC  *»a  4  '‘dauantiapia 

onkiartihina'*  h.ot  m  jac.oj^Akr  t»iih  H  J.e.  ohova.  *kMh  cow*  at  ma*  ha  m  atvatt  •«!  ih*  amount  lunklcd  h*  iha  Crtdil  AgtaamaiM. 

'.  tirar*.  inn  rrookti*  t'lr  (xml*  <a  h.iong^  undar  paraaiapht  0  3  1.  ihrwvah  a.  4pu*a  ata  dua  in-l  pa*ah|a  in  loll  on  ptataPta'ton.  o».  ii  « 
ya*  ihrni  .laia  1*  kyakitirJ  ir.  tt.r  tt  |(k««  r.o  (kMidk  .o  hdl.  x»  tha  pa*M»ai*t  data  t.*  *|«.-MKd.  **an  if  luah  |,•4*manl  laic  it  om  10  avktxJ  uiih  |ha 
rtiin.jicil  i-jtinmi  .khrduir  ■(  .»•*,  .k/ntaioa.l  hi  i-it*  i.blry  ind  tkicpfiiKa.  ’Aithooi  rifai’iina  I'ark** i*ai '*  chhraiioi*  l>>  ihika  vocli  i'4*ma»il»i  «»Aan 
•Iur  lokoincnfiiii.p  c>.it*a«  .iiig  a.i*inka  aitj  taovfatt  pavmant*  a«cim«(ad  irrniinafivn  (i4l*»iil*  iif  a*nt**ita  '••  kon*iru*l.ka  Jvh'at*  «a  ki'i|T*ai'i  1* 
*urrori  of  fri|W(ki  for  'inAik  r  hilK  *ill  ha  mada  a*Hiahla  to  ma  PiOkham  b»  Oulf  uima  rakivrM  'than  ark'r>M-tiatc.  P  irvhaaar  uill  r>-ak.ati  adiuM* 
.-.Km  or  «!••  o>ia*(A.tiat  ril\i  .lam*  n«  vonwiwani  tunmitkiioi  of  rakiu*ta4  diicrapanor  rrpon*  m  aitkordaiKa  uith  (.arttrarh  ft.a.  hakm. 


I't.rm.kar  «  . 


i»<'ra<a  man 
I  .mpnaao  n 


t*raa*  i.i  ya*  intrra*f  *01  a«»  nri  am*  uni  by  •aaka  u  .«  m  aitaart  'ia  paymaiiit,  daiarminad  hk  k.ottakirrmp  .iMia*ti*a*k  a. I  jl  tha 
pan  (1!*^*  Old  Ak-cpuAia*  uMh  Iha  Ihfaffcr  vwd  ha  cauulaiad  -.a  a  .Sod*  hnn  (ha  la'Avipai  amno'.i  1  iha  afpr«ra4r  mail  pc 

III*  rfkC'k  ..I  k  ..niuiaiica  (.naokiai  raauttrmaMt  «-f  ina  Purkhaift  •»*«  Mill  rwmniaioa  ia»iAai>li  *Pa»  t  oariail*  rdlinr  pa.  ■*;»At  dt«« 
la  tmarati  >•««>  kiia.i  ha  a  .aia  ••.•!  l<*»  :i.au  a  r^ia  dviarm.AcJ  t*  :hA  aaifatai*  •d  iha  Tiratm*  iabii«4  mi.i  (•*A«iJariin*A  iha  rurrani 
ri  .raikJ  n  .fit  md.  «  iiNora.rm  •■«>lr»a«i>oit  .0  (ha  USC  a*  •*»  Iha  ia«i  da*  M  tha  moAin  prr*:r-fo<l  ma  ••ai  wraarara  a"d  tnaU  Pa 
ini  inr  djir  'd  nai  arrearaa*. 
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V 


L  j ;  r'KAw  i  1  CJ'.niiM 


k.  Stan  ita  h’ocufi*#  A«M«|>  faifMMbW  tafMit  OTfk*  $mtl  »44nm  itar— #  t*  wtack  tta  USC  ttaN  MtaMi  f«k««wt  (a* 

AMta  Min  Mil  HM«r  ikH  orr«r  iM  Acc*9t«aca. 

«.  Stall  MIMf«Kt«»«l  fM  Ita  MMM  «ttl»  ta  MVIMMir*  A#  IM  nrflt  M«  Swcfe  lAMvCtMM  iMin  WCtMt  (•) 

c«n«%  <«)  CM«,  %•*  Uk  tta  klMk  itt  Cota,  a* 

U  StaH  ta  /or  okiMMf  ita  •ppropruu  eermgo  iM  amorm  doiw— .  lan.  tm  Mtmm  ••M'tM  kr  ita 

USC.  iMtoprwr  *is«*l  tarowfc 

A.  Stall  Mwot  tiilt  to  Ita  d«/MM  «i«cM  M  Ita  Hiiial  MH**  «tao«M«i  («m  A.4.  itaMot.  hoctaMr  tinll  ta  raioomikla  f*m  mitmui 
MceiMiMit  IM  •rilltMMM  of  CIMOU  MMOM  TtllT  lA  ta/aitw  imcM  irantiwwiM  0?  POTMI  poM  <o«ll  pow  lo  Ita  PiockiMr  m  tai« 

•/  Mre«l  p<«i  ikifiMW.  SiataMd  Faria  Jta  ttaU  •<  «i*tl  m  twOoiMlia*  cImoh  lo  ita  USC  fn»  orrrota.  itariM*.  4iiaa— .  4wfl*cM«  Mlw*t.  mm 
taAcMacf,  Maproorr  id«aii/MlMa  or  uaprop*  ilo<*MB«aiMMO  iM  ttall  ta  iwkMalM  or  fwctaMr  prrMaplIv.  CtoiM  ol  tlOO.00  or  Im  «all  aot  ta 
nporttd  /or  o*frM<i,  tkartapn,  or  4aaut««.  Claiiaa  lacaivM  a/iar  oaa  Mor  fro«  4ai*  of  powat*  ol  ••il*  or  ooiMp.  okictaw  m  blor.  ■v*N  ta 
•llowod  bf  Ita  USC.  oaltM  Ita  USC  taiarouaai  tta*  MMiwal  ao«  «o«pa«lM|  cvcoioMaocoo  M«o*«iot  >o*aM  talmi  iwMifp  rowaalaraima  ol  ita  alar*. 

Y.  Mar  aocol  ili«  o/Tar  aoo  Arcaoiaoc*  onli  raipact  lo  aor  or  all  o/  ita  iirMa  talao  m  IM  0l/a«  aM  Accopiaoc*  af  aor  itow  prar  lo 
Ita  talmry  of  ta/mt  wlKlaa  or  prrlormaoca  ol  larvam  (m«im«»c  traaiocK  II  iMU  ta  raapoaoroia  lor  all  coau  ratoliMt  Irooi  caocaHaiaoo  aatfir 
mo  paroMBpA. 

t,  StaN,  aactpl  aa  au?  oitaroroa  M  anioaHr  aprrta  «o  «>ni«g.  oat  tta  iiaaM  aoM  tattwoPat  oolr^ 

a.  for  Ita  paipoiia  tpacilWP  m  ita  Moiuol  Oafanaa  Aaataaoaa  ApraaoMOl.  tl  a*r.  taiwoao  ita  USC  aap  ita  Pwctaaor; 

k.  for  tta  pMpeaaa  ipac^lta  m  aap  kilaiaral  ot  rapMOal  Pa/aoaa  iraair  to  otach  ita  USC  aaP  ita  Forctaaar  art  bMb  poniai.  d  lakpara 
prapk  a.  of  iMa  patapipfc  «  utappliraMa;  or 

c.  For  MarMl  aacortip.  fPtaOaal  aall^afaoM.  and/or  ci«*c  anioo.  if  tMkporavaplia  a.  aod  k.  of  ikia  paratrapk  ara  laappkeakla. 

P.  Stan  *ol  ira««/ap  itila  lo.  or  rTfifl-  of.  ita  daianaa  artMlaa.  tompooakU  aod  aaaoctaiad  loppori  Mpianol.  rrlatad  iraMtop  or  oihar 
dalMaa  aartaeai  <wiclMiap  m*  plaM,  tpacdicalteoa  or  tA/nroiaiirtot  lidootao  oadat  IM  Ollta  akd  Acaapiaoca  lo  aorooa  aot  ao  iiltwar.  aorplarat 
.  or  apaM  of  tta  puretaaar  (aadodtoc  traoaparuiteo  apracwii.  aod  tkaH  aoa  «na  oa  pttaoi  ikaw  vao  /oa  pwrpoan  itioar  ikao  iknor  aatkoairad  kr  ILS. 
•boat.  MHMaa  Ita  oniiao  eonaafii  ol  ita  USC  kaa  lirM  kaao  oOtaroad.  To  ita  aaiaoi  itai  aoy  tlam.  plaaa.  tpactnmioaa.  ur  >Ml<ooi»iMrii  faraHad  m 
roaoaaiioo  «wiik  ikia  Offar  aod  Aerapuoca  mr  ta  cUuiAad  br  im  USC  for  taaMdr  pvtpoaas.  tta  Pyrckaatr  rhall  MOMHark  a  itmdM  ctaanficMiwA 
and  amplof  all  maaaurca  oactatarr  <o  praatrat  tuck  •arurity.  moraalroi  lo  ttaaa  anptornl  k?  ita  USC.  itaeotkoM  ita  pvroHl  dHtiop  wfcicfe  ita 
use  mar  ciomiam  lock  damdKattao.  Tka  USC  oiU  mm  oa  baai  al/oaia  to  ooiilv  ita  Purckaaar  d  ita  claaM/teaitoo  o  ckaopad.  Tta  Pwctaaar  «dl 
iiMioa  br  aH  oiaaM  avaibblt  to  it.  mpact  lor  propnaiarr  ripma  •«  aor  oa/aoaa  an*aia  aod  aor  pImb.  iptadiaiioka.  o»  ■oliwomiioo  loraokaP. 
ratalka*  paitoiad  «  ooi. 

C  IMOIMNtFiCAnOM  ANO  ASSUMFTION  OF  NISKS: 

l.  n  d  Miiairwauf  br  tta  Fwataarv  ital  ika  USC  io  ptoconta  aod  forootaot  tta  N«ma  aoaoflad  «  itaa  Oflar  aod  Ampaaoca  doao  to 

oo  a  Aoopp«/lt  bauP  /oa  tta  baoa/M  of  ita  Pioataaar.  Tta  Purckaaar  ttaralora  oodaiiahra.  luOfcct  id  KX  aboao.  lo  lodamodr  »od  mod  tta  USti. 
da  atmla.  of/kon,  aod  ampleraaa  tarmlas  /root  aor  aod  ail  iota  or  takdiir  fvtaitar  in  lovt  or  lo  cooiracil  wkick  mipbi  aro«  lo  cmoccioio  odk 
ikM  Of/ar  aod  Accaptaoca  kacaina  ol.  (i)  ao|utr  lo  or  dmik  ol  paiioooal  of  Puretarar  oa  ikwd  partm:  |mI  damaa*  lo  or  daitruchno  id  (A) 
propanr  ol  ita  OOO  o«tad  to  PurckMat  or  iupplMn  tpam/iaallr  l»  miplamaol  lk«  Olfaa  aod  Acnpuon.  |H)  paopartr  “/  Pmcaotar  iioctadmo 
Ita  nama  oadarad  br  rwrehaaar  puiakooi  lo  ika  Olfar  aod  Aecopikon.  talort  or  altar  poarapa  ol  inlr  lo  Pottbaaar/.  or  (C)  paoparir  wf  itard  poriwa; 
oa  (tii)  patrol  lotHogroraoi.  , 

1.  Skbirrt  lo  aor  aaproaa.  apacW  ceoliBclual  M«moifaa  okiamad  for  ita  Pkrrkaaar  io  accord aocr  wdh  A.T.  ohor*.  ita  Piocbaara  rowta 
M  raHaaa  ita  cooirociora  aod  lulicooirBcion  of  tta  USC  from  liataMr  lor.  and  unit  mboom  tta  rok  ol.  lota  or  damaae  to;  (i)  Purctaait'k  protartr 
(ioclodiof  Ike  ilcma  proiorrd  pmiiiaol  lo  ik«  Ollar  rod  Acccptaocr.  tafora  or.  altar  paaaata  ol  mis  lo  Purckaarsl  aod  |m>  protaair  >d  ike  l>Ot> 
/Wfiotad  lo  Mppkrra  tpaciAallr  lO  oHpIrmaoi  iko  Ol/ar  tod  Accapuocs.  to  tta  rpiM  aaicoi  ikal  USC  oookl  aaauoia  for  iit  profMSir  d  d  <Mta 
procuriop  for  iiarif  Ika  icam  or  danai  procurad  punoaoi  lo  ikit  Offaa  aod  Acaapiaoc*. 

O.  ACCCFTANCS: 

I.  To  accapi  tk«  Offar  aM  Accvpiaoct.  ita  Forckatar  «><•  oot  latm  ikao  IM  aapoaimo  data  af  ita  Offet  akd  Acrsptaoco.  aa  ««t  mnk 
tarolo.  rciom  Itiioa  copiai  proparir  ufood  to  ika  Mcordr  auwaoca  accoooitoo  ctoiar  dtupoaiad  kataio.  accomporuad  kr  iiKk  mmisI  dspooi  m 
Mkar  parmsMl  m  mar  ta  laoowad  kr  ika  Tarma  taiato.  I*  adoiiieo.  Purckaaar  oOl  coocuaraoiir  rriurk  ikaas  coita«  proparir  ripkrd  in  ita  U.S. 
MiUarr  Oaporioiaoi  or  OafaoM  Aptocr  makoif  ika  offrr.  Wtan  protat**  acttpiad  aod  rtiurkcd  aa  rpociAsd  ksiM.  Ita  prnrooMa  of  ik«  Offar  aod 
Accaptaoca  atan  ba  ktodmi  upon  |M  USC  ata  ita  furckaaar. 

I,  M  a  Modantood  that  imotaowoiaiwM  ol  Uw  Offar  aod  AcavtNaoaa  canoot  precoad  ioiiimmM  a  lonpar  arcrpaaoca.  Padora  wr  cnmidr 
tall  Taroa  aod  Coodmooa  paquood  for  accaptaoca.  aa.  for  rrampia.  daiar  in  ankmarmo  nf  tkr  miwrM  mdol  depuM  m  parourki  td  Inti  cMrmaiad 
coal,  aa  ita  coaa  oiar  ta.  oiar  laounr  «a«a*oo  or  raoawa  of  ilia  Offer  *mf  Acccptaocr. 

X  Uoirra  a  writiak  rapnaai  f«i  aaiaotioo  «  oiaOc  kr  ita  rurckatar  aod  iraotrd  m  mdiop  kr  ao  anakorrrcil  rvpr«*rMali«c  of  Ita  apprnprn 
aia  UJL  MHiiarr  OaporCMoi  or  Oalanta  Apeocr.  ikd  Offar  and  Acc«P*aoc«  atall  taroiMatc  no  ita  sapoainio  data  lai  fmik  kanro. 

C.  EffCtOSUNCS: 

Etaloawaa  ailacoad  tamo  ar«.  br  ikia  icfcrrocc.  ioeorporaiad  tarato  aod  aro  mads  a  port  karsof  aa  ikuock  lai  firnb  lO  foil 
F.  PUBLIC  IMSPECnON; 

TTda  Offaa  aod  Accaptaoca  mil  ba  owoo  amlabla  for  pwkbc  lOipactioo  to  tta  fullsai  tMani  poMbIs  cooatMaoi  mik  ita  natnioal  aacurdr  td 
Ita  UoHad  Siaioa. 

EXPLANATORY  NOTES 
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ki  oPl««ii  kaadad  **tla«  Oatoriptwo"  aa  aaoia  lo  ba  loaiallsd  m  ita  apptaakta  rod  iiam  prmr  lo  tkipmaot. 

1.  Tta  plaoitad  aoiocc  ol  wpptr  fo*  rack  dam  •  ceprewad  lo  tko  ftdtawnp  endec; 

S  <")  Sar««cc  Siocka 

P  (•)  nocuremaoi 

R  (*)  KcbmWfMrpair/Mndificafroo 

X  (*)  Stock  aod  prockreowm,  €4.,  lotilal  repair  porta 

t  fs)  '‘MiiMt*’ matpr  Mcms  M  lao|  twpP'P  b*  rarpca 
*Ayodabililr  •  ruled  lo  otooika. 

4.  CoodNioo  of  tta  dalfoaa  artretaa  akowo  w  ita  ''AVAILABILITY  AND  RCMABRS’  iwlwmo  •  sapreawd  ur  ita  fonowrop  rodra: 

At  -  (tame  IO  ba  prosrdad  «i  eroiwp  coodilmo  wiikool  ropan.  rawoaolioo  or  rthskibisiien  wbirk  loar  ta  radwoad.  Cood«».'w 

mdicaiad  M  iiaoi  darenp iroo. 

M  •  AriKlai  of  obrod  eoodilion  (oaw.  raworkad.  aod  rahobibtHad>  owy  ta  cooMnmtlsd  «kao  oawsd.  Faampta;  rapov  font,  swmaow 

lloo.  Ml  araaoiotat.  an*,  loel  rair  aod  rkop  aau. 

B  •  SarwcaalHa  dsfaoM  artictta. 

O  -  Obrotrls  or  nnnotataard  iiam  io  ao  ''AS  IS**  mod'ireo  lor  «Mck  rapan  part*  mppoti  owv  om  ka  aasdakir  rmw  IHIM 

S  -  SiArttikia.  Suiirkla  laorlMalioor  may  ba  tkippad  Iwr  wos*Mtskla  dsfsnra  sriKlca  wolaw  omsnsns  sdmtad  ky  ilis  I'wtkwrr. 

U  -  RawerarO  or  rskabdifaiad  Oafaora  ariKlet  ponaiarOfl  ordinal  appaarsora  mnd*  m  prariicakla;  lotlwdioc  dl  Miuitfoalnto  Wmk 
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1.  DD  Form  1513*2  is  utilized  to  record  modificationi  to  an  existinc  DD  Form  1513  and  any  related 
amendments  thereto,  but  only  for  tliose  modifications  which  do  not  constitute  a  change  in  scope.  Mndifica* 
lions  appropriate  for  DO  Form  1513*2  include  ail  notifications  of  price  increases  am*  reioted  changes  in  pay* 
menl  schedules. 

2.  Changes  in  K'opeof  a  00  Form  1513  re<|uire  a  formal  amendment,  utilizing  00  Form  1513-1.  Such 
changes  are  those  which  affect  the  type  or  number  of  maior  items  aivl/or  services  to  he  provided  or  which 
siipiificantly  alter  system  confifuretion  or  functions.  Such  changes  must  be  made  by  utilization  of  00  Form 
1513-1. 

I  3.  DD  Form  1513-2  does  not  require  acceptance  by  the  recipiera  country  (tm§iom9rt  but  merely 
I  acknowledgement  of  receipt,  too  Form  tStJ  l  doot  '*re««v  •rrrpfwim. 

4.  All  terms  and  conditions  of  an  existing  PD  Form  1513  and  any  related  amendments  thereto  not 
I  specifically  noted  to  he  modified  by  a  OU  Form  1513*2  are  understood  to  remain  unchanged  and  in  effect. 
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APPENDIX  D 


INTERVIEWS 


I 


Introduction 


One  means  of  determining  an  acceptable  level  of 
price  estimate  accuracy  (research  question  #1)  was  to  inter¬ 
view  people  in  the  USAF  euid  in  foreign  air  forces  who  work 
with  FMS  programs.  The  people  interviewed  were  Foreign 
Liaison  Officers  (FLOs)  from  Australia,  Canada,  Thailand, 
Venezuela,  and  Indonesia  who  are  stationed  at  Wright- 
Patterson  AFB.  In  addition,  people  working  in  the  Office 
of  Assistant  to  the  AFLC  Commander  for  International  Logis¬ 
tics,  the  Office  of  Deputy  for  Operations /International 
Logistics  Center,  and  Defense  Institute  of  Security  Assist¬ 
ance  Management  were  interviewed.  The  object  of  the  inter¬ 
views  was  to  learn  the  opinions  of  these  people.  The 
interviews  were  informal,  with  a  list  of  questions  used 
primarily  as  a  framework  to  guide  the  discussion.  We  made 
no  statistical  study  of  the  answers  to  the  questions.  For 
the  purpose  of  this  thesis,  the  most  important  question  was 
one  which  asked  the  respondents  to  give  their  opinions  of 
an  acceptable  level  of  accuracy  of  price  estimates  on 
defined  order  cases.  The  other  questions  were  used  to 
focus  the  interviewee  on  the  topic  and  to  gain  some  under¬ 
standing  of  their  attitudes  toward  FMS  and  problems  experi¬ 
enced  both  by  USAF  managers  and  foreign  customers  when 
dealing  with  FMS  price  estimates. 


Questions 

These  are  the  questions  asked  of  the  FLOs: 

1.  How  long  has  your  country  been  buying  defense 
articles  from  the  U.S.? 

2.  How  would  you  evaluate  the  logistics  support 
provided  by  the  DOD  on  firm  order  cases? 

3.  What  is  your  opinion  of  the  accuracy  of  price 
estimates  given  on  a  DD  Form  1513? 

4.  Assuming  price  estimates  cannot  be  100  percent 
accurate,  how  accurate  should  initial  price  estimates  be? 
What  level  of  accuracy  is  acceptable  to  your  Air  Force? 

5.  How  does  your  Air  Force  prepare  for  price 

changes? 

6.  How  seriously  does  your  Air  Force  take  the 
prices  on  the  DD  Form  1513? 

7.  If  there  is  a  change  in  the  material  value  of 
a  DD  Form  1513,  does  this  cause  any  problems  for  your  Air 
Force? 

8 .  How  is  a  price  change  handled  by  your  Air 
Force?  What  must  be  done  to  approve  a  price  change? 

9 .  What  impact  do  price  changes  have  on  your 

budget? 

10.  Has  yovir  Air  Force  ever  cancelled  requirements 
because  of  price  changes? 


These  questions  were  asked  of  USAF  personnel; 

1.  How  would  you  evaluate  the  logistics  support 
provided  by  the  USAF  on  defined  order  cases? 

2.  What  is  your  opinion  of  the  price  estimates 
given  on  the  DD  Form  1513? 

3.  Assuming  price  estimates  cannot  be  100  percent 
accurate,  vdiat  is  an  acceptable  level  of  accuracy? 

4 .  What  are  some  factors  which  impact  AFLC ' s 
ability  to  make  price  estimates? 

5.  How  can  AFLC  iit^irove  its  price  estimates? 

6 .  What  can  foreign  purchasers  do  to  help  AFLC 
improve  its  price  estimates? 

Summary  of  Comments 

In  addition  to  helping  us  answer  research  question 
#1,  our  interviews  were  useful  in  gathering  other  comments 
relevant  to  price  estimates  on  the  DD  Form  1513.  Follow¬ 
ing  is  a  summary  of  what  we  learned.  While  these  comments 
were  collected  in  aui  informal  manner,  they  provide  a 
glimpse  into  the  real-world  effects  of  AFLC  price  estimates 
and,  as  such,  may  suggest  areas  for  further  research.  The 
comments  are  the  personal  opinions  of  the  people  interviewed 
and  may  not  represent  the  official  view  of  AFLC  or  of  a 
foreign  air  force.  It  was  not  within  the  scope  of  this 
thesis  to  investigate  the  price  estimating  policies  and  pro¬ 
cedures  referred  to  by  the  people  who  were  interviewed. 
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Therefore,  this  thesis  did  not  attempt  to  learn  whether 
present  policies  and  procedures  are  adequate  or  whether 
they  are  being  properly  applied. 

In  the  opinion  of  many  of  the  Foreign  Liaison 
Officers  (FLOs) ,  logistics  support  provided  by  the  USAF 
is  generally  good,  but  to  be  really  effective  it  must  be 
coupled  with  preparation  by  the  foreign  purchaser  and 
experience  in  working  with  FMS  programs.  The  general 
opinion  among  the  FLOs  was  that  price  estimates  on 
DD  Forms  1513  were  low.  Ideally,  they  would  like  esti¬ 
mates  to  be  as  accurate  as  possible,  but  could  tolerate 
accuracies  of  ±10  percent  of  the  estimate.  Some  purchasers 
are  skeptical  of  the  prices  quoted  on  DD  Forms  1513  and 
try  to  adjust  the  estimate  using  their  own  experience  and 
interpretation  of  factors  such  as  the  inflation  rate.  Many 
try  to  budget  for  an  amount  greater  than  that  shown  on  the 
DD  Form  1513.  The  problem  is  that  at  times  the  entire 
amount  requested  in  a  budget  will  not  be  approved.  Among 
the  problems  involved  in  having  a  price  increase  on  an  FMS 
case  is  the  problems  of  dealing  with  bureaucratic  pro¬ 
cedures  in  order  to  get  additional  funds.  Depending  on 
the  country  involved,  cancellations  or  reductions  in  quan¬ 
tity  are  sometimes  made  to  manage  price  increases.  However, 
many  times  this  is  not  a  practical  solution  since  the  items 
involved  are  valid  requirements. 


From  the  USAF  point  of  view,  logistics  support  pro¬ 
vided  on  defined  order  cases  is  generally  good  because  the 
terms  of  delivery  are  specified  on  the  DD  Form  1513  and 
most  items  are  understood  to  be  procurement  lead  time  away. 
The  quality  of  support  provided  is  dependent  on  the  Pur¬ 
chaser  providing  correct  specifications  and  providing 
sufficient  lead  time.  In  giving  their  opinions  of  the 
accuracy  of  price  estimates,  no  one  thought  they  were  com¬ 
pletely  accurate,  but  there  was  no  consensus  as  to  whether 
the  tendency  was  to  over-  or  underestimate.  All  agreed 
that  ±10  percent  of  the  established  price  was  an  acceptable 
level  of  accuracy .  Among  the  factors  impacting  AFLC ' s 
ability  to  estimate  prices,  these  were  the  most  significant 

1.  Inflation  varies  with  the  items  and  technolo¬ 
gies  involved,  but  AFLC  uses  a  uniform  rate. 

2.  AFLC  often  does  not  have  a  good  idea  of  the 
contract  cost  until  after  the  DD  Form  1513  is  implemented. 
In  fact,  in  many  cases  policy  does  not  allow  AFLC  to  get  a 
contractor's  estimate  before  case  implementation. 

3.  Special  factors,  such  as  tooling-up  costs, 
may  not  be  known  at  the  time  of  the  price  estimate. 

4.  Pricing  data  systems  are  not  always  current. 
There  are  also  problems  with  the  software  and  hardware 
used  and  with  the  interfaces  between  various  systems. 


5.  Price  estimates  are  often  not  checked  for 
reasonableness  or  human  error;  in  other  words,  there  is 
little  quality  control. 

6.  AFLC  doesn't  use  available  data  now  in  the 
system,  including  procurement  history  and  price  trends. 

7.  Inflation  factors  used  are  not  always  accurate 
and  may  be  improperly  applied. 

8 .  The  people  making  the  price  estimates  are  not 
experts  in  this  field;  this  problem  is  compounded  by  the 
rudimentary  methods  of  price  estimation  used. 

When  asked  what  could  be  done  to  provide  better  price 
estimates,  it  was  suggested  that  spending  more  time  or 
providing  more  people  to  do  this  work  would  make  the  esti¬ 
mates  more  reliable,  but  the  need  for  greater  accuracy  and 
cost  of  attaining  it  were  questioned.  Many  of  the  respon¬ 
dents  felt  that  given  a  choice,  many  foreign  purchasers 
would  prefer  that  we  overestimate  on  the  initial  price 
estimate  so  they  wouldn't  have  to  go  back  through  their 
budget  channels  for  additional  funds.  All  agreed  that 
there  isn ' t  very  much  a  foreign  customer  can  do  to  get  a 
better  estimate  on  their  DD  Forms  1513. 
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CASE-SO  CT  TYo  SEO  SRCE  ES  TDV  ACC 


c'K^^'r(«oeme^‘<-)<o^v4eK>o\«4t0^^C'inr«Ke>ae(vjKKi 

c3(Vlc\j<Dni.r<-ar04aifi.^«0(\ir3a«aicOK.lAtacsi(\iAmcs-aoiAt<\lA 

a(rcvi«<ir>ifoav<;^T4r>jrocoa}a«9u\i<»ncMa«Hv4v4trfOci^rov4 


CM 


«o«or^(£(r><MMir^N>v4C3onoK(viasou'>-oatt3'tMCM&<i:.oo'r>-a 

c^(T«<jta>u\^rocMv4^«(Mv4N.(Mmik.cjroaucoCMAro^mu>«o«CM 

<n«4^^c<CM  ot  a  jr  mmt  tn  «-i<o  Mm 

in(_<40>0  n  M 

>o 


r 


_jar^tfoa'_i_i_i<'>_i_ix'r'(cT'cnccmmcnii)iT>crmn  .j«c)..i« 


iUJ2UjlUlu»-iMMk^^k)(t-</)Z2ZZ2:ZZZZZOUIluU;»-»- 

:zzQ.a.a.a.a.a.a.a.aa.a.a.vv:^^^^v^^;^vzzzz«« 

i(Mro^iniOh>»a>wi'T4rMn^u\«c^«(rc7T-t(Mfo^tf\vDr>«a'c.^cM 


SAMPLE  CASE  DATA 


184 


^«Oh:r^O'Aa'ca«av4cvj(\j^^<acom«£>4'i£oto(\Ju\Ko'Hu\«-i«i;oooi>> 

u'\roe>i«.v4iOv4a(r(r4‘0«^inaa^«cvia>(via>oicn^maoeoi»>rtcNiaa' 

ti>u^Ci>3'C\ia'0'irtiAv0*^^u-.  onojj  <vi.i>^a>c7  n  ^  ^  ^  iAi^cviM>^T4w?vt 
^rOiOM  tn  v4  n  Kif^citocvicvJm^-tiO’vHc^  lOasMc:^  w* 


SAMPLE  CASE  DATA — Continued 


SAMPLE  CASE  DATA— Continued 


tOO'T  *12^  •<l2f 

096*  'ESfi  MSS 


'<-*u^a^e«oa^>c•ee'r40«roe«>om^«(rO'a^a'K^J(T>a'u^ 
u\'«^;3>A>oati3<na>3«3mi(ve3a<j(ain«m.'»<T>iAu\a>t:<ik.(Tta«a 
c\ioa(viro«)<j«4a  a>^oc»cic*s3de>*4N.«eo*4a>CP«i>.a*74eo 

'T4^'T4v4a>v4v4«4v4«4«4v4'*4C\i'<4v4v4T4T4Wt^  v4  CSJ«H 


«i>  CNi  O  U\  C;i 
a  r*j  m  CM  ^ 


cjro^e.'e<«)ic\'<4aM(ru'.  coooVarcMCMtttAwrou^ 
lan^ooecc  (J«^to<MO^u>«4^-'^>■'Oo■d-nv4ronc» 

~~  '.«(M'Aff'0>0'UNf*'h>>OT^N-m<M^«ac  SM.tKJ 

A  CM  u\  (M  CM  <D  m  ^  m  •/)  -a 

to  a^.VinCM  ^  ntCS<4CM 


fo.^caK>e>>ncam.'+-^eiK.r>.^*r«Aim>om«>>«K..«<M«>cTi^^mn> 

««-i«4^c3romtaj^^ea(Mm^(T«mif\^a^ii\airo<n»4ro0ro>oii\<M 
IM^-itAtn  «T>9  U\<M  fMCM  mcftm  O'SCMCM 

•4  a-i  ^  (Mtrt  cvim  incM  roro  n\is.«4K^ 

CM  K>  lA 


•9 

i 


za;<^OQ'o»»oi-z»-Q:soa:Qfi--»-or_tro<oooooco_j 

(/1Z(/)M03:0000(/)03C/>032000C/>MU)OC/)OOOOOOOM 


a.>|:c>'<cD3>zu.z<«~) 

t-  »-l3  3>C9(Cd  <X>«OUCD 


»-ZNiUirMffiUJ|i.aUX3<Q^»-33a 

xu«ud>x««ii.aja:cccxai^u 


cr-crrncDoa«rt3'r_j'9'_i_j_i-i_i_ja._ivcnm'»j_i()t>««0acrci. 


Z2ZZZa:QCt-»-Ci.l-Q:Q:b^bu»-«O</>b0XZXli.U:u<OOX3XZ»-»- 

XXvVXX«««O««ffi(t:C0»-l^'^XXVX^Z(/)Cl.ZZ»-l~»-O«I<X 

«4CMlO^U\^h.«OfC>T4CM^)^U\«Ci|k.<OO<«»T4CMni^Ui««0h-a3Cr>^*-ICMfO^ 

'^'-^•_;&0.ae.».»4HT4»<»-t.»4.*4»4»4T4.^tM(M<M<M«MCMCM(MCMCMroror»JfOK 


SAMPLE  CASE  DATA — Continued 


ooo«->-ooooQrxov-Q;Qr_ioor 

OOOOOOOOOXV)0033mOOV> 


u.««i.x^^«u«zcD««xxistijxmuj 


«  _l  « 1  lO  « •>  LO  f  •»  >.  >  T-  X  _l  _l  _l  O'  «*■  f  1  _1 


^»-9>>->'u:uixzxxxxzza.(A^ 

<(UI4UOUU)OouUOtJO(JOU>M< 


iri«oi»>aoa'c3'>-icMro^m«ON'<ca>e^cvjn 
fo  fo  M  r*/  j'  j  .»  jr  j-  j-  j  ^  u\  i(\  i{\  u\ 


cnc>iHO'«0eee'o«oo'otfv<^e^(OtOire3Krov4 

oOfomuau\Q4BO«4«oea«OI*>Ma^a'c:oiftf^U\ 

^^S>Ov4f0^^eJaCI^J^«sJ<r•IAUV^>•r40'(^iS«tftO 


OCOOKC  (MrO«OU/ICt»>C  «0<irfU>«^C>(OU>CVJC<a> 
a«ao'r4N-a'(ri<\^a«u\o««ci«o^T4«ON.«fi(T>)oatu> 
u>▼4*-leoC''*>co(^Jsr^(Mtnu^(^J4■*>T4N■(Vlw^<^i^^^ 
»i>^N.u\dOv4Cvi.<»aocvi  v«  u\  e  tCiio 

csj<vi  toioci 

W  «SJ  M  ^ 


M«)ina/«<n.^ro<nsntnm«>4<M^>A<^’^m>na>‘SK. 

<n»4^mmeat(\j«>  «v«u\(nnt.»iAv4inioeiK>ac. 
N..'VCn>AK.^CVI.»eKt  •4<9«-«  K>  l(\  «t  «im 
K.n\»->lC<T*»<  «MM  fO.fttft 

ro  M  «-l  <M  V4  ^ 


<v-<ut->oH>»-<oaro4to^»-ou 

c/)0(n00000(003:o(/>00000 


_l  O'  «  o  o 
M  Z  (/)  o  o 


a  (/)uo>zaH<_iaiQ'>'^ouuuu.ou_iu. 

tf<aC3tfo'««ui0U.~9O'4OOtf:3<a<icm 


_iT’_i  ia'rfXT_i»i_irf_i<'>_i_ic">_im*(n_i^ 


zo'aa:Q:a;Q:zu<uj>-zzz^ZKitt4.KC/:«i4 

hHKItHHiMt-ttHtHaDa  OOV-~33Zr-«Q.«^  ~>'n 

•d-intOi>l«9ar>OT4<Mro.»i(\vai»><oo«c.  'Hcvjr^.^tftvO 
lA  1/^  «\  tn  u'k  lA  UJ  \0  (H  tA  <n  U}  aA  «A  tO  fa-  ^  ^  ^  N* 


CASE-MO  CT  TyP  SEQ  SRCB  EUC  DUC  ACC 


41.54  39.49  1.052 

11. 55  31.20  .373 


«00*ea(v<ev4K)oeeiAo(Viotf>)NDa9«oinvHeotno< 

tf(Mou\n«c3i0^n«<£tc*<0a.«(MfMa«40i£>tnoa:,0aa<* 

csieaN(via<j«iom<aocav3r»o«o.40*o«4ati£ifo^(Ni 

.H  •r*  ^  CM 


«4U>4’<OtOK^eO 

0\  0%  O  t'y  .D 
i/^^orv(^^.Ha%«4c^•U1(M0•(Mc3<6^.v4«Heo^oc'?.|X^«^ 

«4v.^^«-immu\CMm«4  w4  ^  n  ^  to  k,  cuni-i-jutvi 


.aMaiAmcs^inlAa^Ut<p4«4()t>nmalA(M»n(Ti«> 


XQfei(rooj«ta?x-<o<oooo_j<««;rt«t<-ja'o 

M»3EOOM(/)3:WC/lOMOOOOH»MMOTt/)C0trt»-iaEO 


(DXU<<>'X>a3~?<Q;S9»-UJOUUUOOC;aJ^ 

>CDX»>33.-.-C/)4UJ^CDa](I>3li.U.lj.tl.U.U.C^ti.tf' 


aacn(ncncronc^_itfdtf«eo_j_i_i_i 


ZZZZZZZZZZUIUJZ3 

VtJU^V^VVV^OCCOt~ 


zzszzzck:acKQE.(i^K>>u>ii^ 

Ot-.-H>^COCiO(AlOI/)lO«:0(rS 


«0'o^<vin^ir\s0N>a>0'o 

IMCMK>MWf»)r0^jrrjfOf0Mj’ 


vCCMio^u*.  i0^oo(r>i=.^(Mro^ 

J»  ^  ^  ^  Jf  -»  -T  lA  ITi  lA  lA  ir 


eaa'(r‘«Hee«0ecrv4v4eeKoa>ae 

lr\tl\U\^>^C9C3«)C3  CktO^eaCSTClAJCSU 
v«<Hmv40'caca«4oc>jnobiOT4C\Jc*a 


ou\e«ii\in«oe 

ca^tsCuiAuxcncn 

<i3v4v4l9CP(rE>tO 


u\ro'T4m^n4a«>a(MnavfiKo«N'Nid'no'<C3auciieoc 

u\aa>cvi^«ou\v4anh.a'if\a«cviv4ar^tf>aau^nr>>tou\e 


3vou\ia‘oaoa«-i^(\ju\ 


«naiA<\jnfoo«4aiC>jaMtnK.a«-t>o^lO(T>(Mti>ir>(vj^^i 


iA'v4A.«4A.wn\K>mN.»4^>naa«4^^na5r4r>ji\i(lNO«<>'ml 


oooooooooe:Qia'ef'a:o'Q'o«*oooo<r<<t«< 

OOOOOOOO23:23XZ3;O(0OOOOCn(/>(/0(/>(/) 


atcDXuaeD(SUj'n**)^~)~>'*3O««0art«iuujiiJujui 


f  t  (.1  u  r'>  _i  -j  •  _J  _•  _i  _i  f»  _j  f  1  f >  o  f  ^  orr  m  m 


i-4»HC«<<r<«M>-«H4MMi-io«uiM<«zuucjoui- 


lr>>o^>a<r>av4CVirO'.^mvOK«a'ov4(^ifo^u^lD^>a(^o▼4 


SAMPLE  ITEM  DATA — Continued 


3».vr  312.84  l.isq 


SAMPLE  ITEM  DATA — Continued 
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AO-A105  097  AIR  FORCE  INST  OF  TECH  HRIOHT-PATTERSON  AF8  OH  SCHOOL— ETC  F/0  5/3 
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COUNT 


CROSS-TABULATION  OF  CASES 


)>d*X 


CROSS-TABULATION  OF  ITEMS 


t 

i 


1 
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Hq:  li  -  1;  The  mean  accuracy  equals  1; 

y  ^  1;  The  mean  accuracy  does  not  equal  1. 

The  decision  rule  is: 

If  £  X  £  A2/  conclude  Hq  (y  =  1)  ; 

If  X  <  Aj^  or  X  >  Aj/  conclude  (y  ^  1)  . 

where , 

Aj^  =  1  +  z(a/2)s(x)  ; 

A2  =  1  +  z (l-a/2) s (x) . 

For  all  calculations, 

a  =  .10  and  z(a/2)  =  -1.645,  z(l-a/2)  =  1.645. 


Cases;  Overall: 

s(x)  =  .258,  X  =  1.664,  n  =  176; 
Aj^  =  1  -  (1.645)  (.258)  =  .576; 
A2  =  1  +  (1.645) (.258)  =  1.424; 
.576  £  X  £  1.424;  conclude 


g:  z  =  i-HJi  =  =  -.9302; 

s(x) 

z(B)  =  -.9302;  B  =  1  -  .8238  =  .1762. 


Cases;  Source,  Ogden  (00): 

s(x)  =  .095,  X  =  1.328,  n 


72; 


2  =  1  ±  (1.645)  (.095)  =  1  ±  .156; 
.844  £  X  <  1.156;  conclude  Hj^. 
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Cases; 


Cases; 


Items ; 


S; 


Items ; 


Category,  A: 

s(x)  =  .113,  X  =  1.275,  n  =  37; 

2  =  1  ±  (1.645)  (.113)  =  1  ±  (.186) 
.814  £  X  £  1.186;  conclude  Hj^. 


Category,  L; 

s(x)  =  .816,  X  =  2.086,  n  =  47; 

Aj^^2“^  -  (1-645)  (.816)  =  1  ±  1.342; 

-.342  £  X  £  2.342;  conclude  Hq. 


Overall: 

s(x)  =  .059,  X  =  1.153,  n  =  108; 

Aj^  2  *  ^  *  (1.645)  (.059)  =  1  +  .097; 
.903  £  X  £  1.097;  conclude 

-  _  X  -  y  _  1.097  -  1.153 
■  s(x)  ■  -059 

z(6)  =  -.9492; 

B  =  1  -  .8289  =  .1711. 

Source,  Ogden  (00); 
s(x)  =  .089,  X  =  1.159,  n  =  42; 

Aj^  2  *11  (1.645)  (.089)  =  1  ±  .146; 
.854  £  X  £  1.146;  conclude 
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Items;  Category,  B: 

s(x)  =  .056,  X  =  1.123,  n  =  34; 

^1,2  “  ^  -  (1*645) (.056)  =  1  ±  .092; 
.908  £  X  £  1.092;  conclude 

Items;  Category,  L: 

s(x)  =  .025,  X  =  1.050,  n  =  33; 

^ 2  “  1  i  (1.645)  (.025)  =  1  ±  .041; 
.959  £  X  £  1.041;  conclude 
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